Charset

From Braindump
Revision as of 09:44, 19 July 2024 by Jan (talk | contribs)
Jump to navigation Jump to search

Unicode isn't hard if you know the history and where it comes from

https://mcilloni.ovh/2023/07/23/unicode-is-hard/

Teleprinter / TelegrafBaudot Encoding 5-bit, ITA-1

https://cryptii.com/pipes/baudot

Baudot.png

International Encoding

ITU-T T50 IA5 String

https://www.itu.int/rec/T-REC-T.50

ASCII 7-bit C0 set of Control Characters / G0 set of Graphic Characters

7-bit ASCII

Codepages

8 bit, lower half 0000000-011111111 is compatible with ASCII

IBM / Windows CodePages: Windows-1252 (defines the C1)

Latin-1.png

ISO-8859-1 Latin-1 (leaves C1 empty, upper half contains regionally significant characters)

ISO-8895-2 Latin-2 upper half is mostly for slavic languages

https://www.charset.org/charsets/iso-8859-1

Unicode

upper codepoints used for Unicode 2-byte UCS-2 or 4-byte UCS-4

Unicode BMP.png

EURO SIGN: U+20AC

https://www.fileformat.info/info/unicode/char/20ac/index.htm


UTF-8 is 8 bit

0bbbbbbb => us-ascii

10bbbbbb => next byte is also part of the character (character is up to 6 bytes)

Byte order BOM FFFE

HTML Escaping

Java internal UCS-2