[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: Re: BOM requirement in UTF-16

bom utf16
Richard Tobin wrote:
>>If a BOM appears, it determines the encoding.
> According to which standard?  Unicode says (section 13.6):
>   Where the character set information is explicitly marked, such as in
>   UTF-16BE or UTF-16LE, then all U+FEFF characters, even at the very
>   beginning of text, are to be interpreted as zero width no-break
>   spaces.

It's worse than that.  Last time I checked, the media-type RFC for 
UTF16-LE and -BE *forbade* the use of a BOM entirely.   This led to some 
fairly prolonged snarling back and forth; my position was, and remains, 
that these formats are therefore not suitable for use with XML.  That 
may be OK, the people who care about this seem mainly motivated by 
applications where the Unicode text appears in short database fields 
whose type is declared elsewhere.
Cheers, Tim Bray
         (ongoing fragmented essay: http://www.tbray.org/ongoing/)


Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
First Name
Last Name
Subscribe in XML format
RSS 2.0
Atom 0.3

Stylus Studio has published XML-DEV in RSS and ATOM formats, enabling users to easily subcribe to the list from their preferred news reader application.

Stylus Studio Sponsored Links are added links designed to provide related and additional information to the visitors of this website. they were not included by the author in the initial post. To view the content without the Sponsor Links please click here.

Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.