=?UTF-8?Q?Re=3A_=5Bxml=2Ddev=5D_Unicode_is_universal=2C_so_how_come_that

Hi Folks,

Unicode make it possible to write things in different languages.

For example, rather than this XML:

 

a Bengali-speaking person can write this:

<সংখ্যা_ছাত্র>42</সংখ্যা_ছাত্র>

Or, in a programming language, rather than this assignment statement:

              Number_Students = 42

a Bengali-speaking person can write this:

              সংখ্যা_ছাত্র = 42

That’s awesome.

But, but, but, … how come that universality doesn’t extend to digits?

How come we can only use these digits: 0 (hex 30), 1 (hex 31), …, 9 (hex 39)?

Why, for example, can’t a Bengali-speaking person use the Bengali digits: Bengali digit 0 (U+09E6), Bengali digit 1 (U+09E7), …, Bengali digit 9 (U+09EF)?

Why, for example, can’t a Bengali-speaking person create XML such as this:

<সংখ্যা_ছাত্র>৪୨</সংখ্যা_ছাত্র>

or write a program assignment statement like this:

              সংখ্যা_ছাত্র = ৪୨

Let me explain why I assert that the Bengali-speaking person “cannot” do that.

Numbers in an XML document or in a program are just strings and, to perform arithmetic operations on them, those string numbers must be converted to actual numbers. I looked at the source code for the C function (strtol) that converts strings to numbers and here is the key to how it converts a character digit to a number digit:

              digit_number = digit_character - '0’

Yikes!

That generates a number digit by treating the character digit as a number and subtracting the number corresponding to the character ‘0’. For example, if the character digit is ‘4’ (hex 34) then when we subtract ‘0’ (hex 30) we get the number 4. Perfect! But ……… only if we allow European digits (0, 1, …, 9). Clearly, if we were to subtract ‘0’ (hex 30) from the Bengali digit 4 we do not get the number 4.

Thus I conclude:

• When expressing numbers, the only digits that can be used are the European digits
• Unicode is universal, but that universality does not apply to digits or numbers

Obviously I am not understanding something correctly. Please help me to understand.

/Roger