[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: xml documents which exercise unicode

• To: "xml-dev" <xml-dev@l...>
• Subject: Re: xml documents which exercise unicode
• From: "Rick Jelliffe" <ricko@a...>
• Date: Thu, 6 Mar 2003 22:41:54 +1100
• References: <3E619327.3090508@n...> <00ad01c2e1de$dc6aa0c0$6401a8c0@tbp1> <3E6478E0.6070209@n...> <3E673080.980D3759@s...>

From: "james anderson" <james.anderson@s...>

> is there a collection of documents available which exercises unicode? 
> something more than the few cases in the conformance suite? 
> something which mixes texts which would have distinct 
> (eg language-specific) 16-bit encodings?

Well, better than nothing is the Chinese XML Now! test suite at
    http://www.ascc.net/xml/test/en/utf-8/index.html

This has small samples in in various encodings (UTF-8, Big5, GB2312),
correcly labelled and sent over MIME with different types.

One difficulty that people have with character sets for exotic scripts,
is that it can be difficult to know when something prints out that it is correct.
So these tests try to clearly only test one thing at a time. For example,
http://www.ascc.net/xml/test/wf/utf-8/text_plain/zh-utf8-8.txt is

 <?xml version="1.0" encoding="UTF-8" ?> 
<test type="io8">
  <name>Chinese Test #8: UTF-8</name> 
  <data>This file has 1 Chinese character, directly entered.</data> 
  <data>The XML header of this file is <?xml encoding="UTF-8"?>.</data> 
  <data>The character is here: [中] It is the Chinese character for middle. 
   It should look like a box with a vertical line through its middle.</data> 
  </test>

so there is only one non-ASCII character involved.  (I don't know whether
this example will get through by mail!)



Cheers
Rick Jelliffe

• References:
  • [ANN] Sarissa, a cross browser JS API for DOM extentions
    • From: "Emmanuil Batsis (Manos)" <mbatsis@n...>
  • Re: [ANN] Sarissa, a cross browser JS API for DOM extentions
    • From: "Thomas B. Passin" <tpassin@c...>
  • Re: [ANN] Sarissa, a cross browser JS API for DOM extentions
    • From: "Emmanuil Batsis (Manos)" <mbatsis@n...>
  • xml documents which exercise unicode
    • From: james anderson <james.anderson@s...>

• Prev by Date: Re: On the promotion and demotion of information items (was Re: RE: Take 2 - How do you replace comments from XML?)
• Next by Date: Re: On the promotion and demotion of information items (was Re: RE: Take 2 - How do you replace comments from XML?)
• Previous by thread: xml documents which exercise unicode
• Next by thread: Re: xml documents which exercise unicode
• Index(es):
  • Date
  • Thread