[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: [Shannon: information ~ uncertainty] Ramificationsto XML d

• To: Alaric Snell-Pym <alaric@s...>
• Subject: Re: [Shannon: information ~ uncertainty] Ramificationsto XML data exchange?
• From: Rick Marshall <rjm@z...>
• Date: Tue, 12 Oct 2004 00:18:01 +1000
• Cc: "Roger L. Costello" <costello@m...>, xml-dev@l...
• In-reply-to: <416A9039.4020900@s...>
• Organization: Zenucom Pty Ltd
• References: <200410111246.i9BCk6L03785@s...> <416A8DAA.3040307@z...> <416A9039.4020900@s...>
• User-agent: Mozilla Thunderbird 0.6 (X11/20040502)

Alaric Snell-Pym wrote:

> Rick Marshall wrote:
>
>> xml messages compress well because the tags as a group in a message 
>> contain very little information. the message content however contains 
>> a lot of information and doesn't compress as well, hence it doesn't 
>> matter if it's binary or ascii - the information content is high and 
>> therefore the bits to represent it will be high. most arguments about 
>> binary/ascii representation of numbers look at specifics and ignore 
>> the principle.
>
>
> Bear in mind that although XML compresses well, it doesn't end up 
> smaller than the result of compressing a compact binary 
> representation, in general.
>
> As you say, you still have to communicate the underlying information, 
> but with XML you also have to communicate the fact that the tags were 
> there, that the number was in fact a number and not text, and so on.
>
> Eg, the number 53 can be encoded in binary as a single byte. In ASCII, 
> it's two bytes, each of which could take any value. The compressor 
> will need to communicate the fact that it was the number 53, when it 
> could have been the string "UK".
>
> ABS
>
actually modern compressors don't know about the representation and 
don't much mind. they actually work on the entropy of the message and 
the message as a bit stream - ie they don't know there are tags, ascii 
data, binary, data, schema etc. there's not room to go into it here but 
they will compress a message fairly consistently based on the entropy of 
the message, not the representation. different algorithms are marginally 
better than others (bzip2 vs gzip eg), but seem to give proportionally 
similar results.

further info from http://datacompression.info/Compression.shtml

begin:vcard
fn:Rick  Marshall
n:Marshall;Rick 
email;internet:rjm@z...
tel;cell:+61 411 287 530
x-mozilla-html:TRUE
version:2.1
end:vcard

• Follow-Ups:
  • Re: [Shannon: information ~ uncertainty] Ramificationsto XML data exchange?
    • From: Elliotte Harold <elharo@m...>

• References:
  • [Shannon: information ~ uncertainty] Ramifications to XML data exchange?
    • From: "Roger L. Costello" <costello@m...>
  • Re: [Shannon: information ~ uncertainty] Ramificationsto XML data exchange?
    • From: Rick Marshall <rjm@z...>

• Prev by Date: Re: New release (2.8) of XSV
• Next by Date: RE: [Shannon: information ~ uncertainty] Ramifications to XML data exchange?
• Previous by thread: Re: [Shannon: information ~ uncertainty] Ramificationsto XML data exchange?
• Next by thread: Re: [Shannon: information ~ uncertainty] Ramificationsto XML data exchange?
• Index(es):
  • Date
  • Thread