Re: Detection of non-Unicode characters
On Fri, Aug 23, 2002 at 02:24:51PM -0700, Tim Bray wrote: > Mark Feblowitz wrote: > >We've gotten ourselves in a slight muddle. We've copied Word documentation > >into (many) xs:annotation blocks in our UTF-8 .xsd files (there are around > >300 files). In the process, we have apparently brought along some > >non-Unicode characters. This is not tolerated equally well by all tools. > > Second possible problem is that the UTF-8 is good but it encodes Unicode > characters that aren't allowed in XML, like for example  - any > decent XML parser should catch this and give you helpful error messages, > if you have an expat around your system (and a lot of people do these > days) "xmlwf [filename here]" will do the trick. D'oh, now that I think > about it in fact I bet xmlwf (or equivalent) would probably catch the > UTF8 breakage too. -Tim I would bet it's this. Just this past week I have been debugging a broken application that is supposed to generate XML from Word documents. The main problem I found was that the Word documents are full of characters like 0x07, 0x2012-0x2019, and the like. The latter range consists of common punctuation symbols like dashes and left and right quotes (AKA 'smart quotes'). They appear to be using Code Page 1252 mapped directly into Unicode. P.S. Why are those punctuation symbols illegal in XML, anyway? -- Matt Gushee Englewood, Colorado, USA mgushee@h... http://www.havenrock.com/
PURCHASE STYLUS STUDIO ONLINE TODAY!
Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!
Download The World's Best XML IDE!
Accelerate XML development with our award-winning XML IDE - Download a free trial today!
Subscribe in XML format