[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Free Tool for Efficient XML Data Compression

• From: "Hartmut Liefke" <liefke@s...>
• To: xml-dev@i...
• Date: Sat, 18 Dec 1999 15:36:06 -0500 (EST)

We would like to announce the release of XMill, a compressor for XML
data.  XMill typically compresses twice as good as gzip, at about the
same speed.

XMill is written in C++, and its distribution site is:

   http://www.research.att.com/sw/tools/xmill


TECHNICAL SUMMARY. The idea in XMill is that XML data items are
grouped according to their tags, then each group is compressed
separately with gzip.  This is XMill's default behavior, and already
results in better compression than gzip.

Furthermore, users can select particular semantic compressors (such as
for integers, IP addresses, state names, ...) to be applied to certain
data items, or can override the way data items are grouped: this
further improves the compression rate.

In complex applications where XML files contain highly specialized
datatypes, such as images or DNA sequences, XMill can be extended with
user-defined compressors for those data types.  XMill defines a C++
Semantic Compressor API (SCAPI) for such extensions.


PAPER.  A technical paper describing XMill is included in the
distribution package, and is also available directly from:

   http://www.cis.upenn.edu/~liefke/papers/xmill.ps.gz


HIGHLIGHT. It is known that XML files tend to be larger than files in
application specific data formats.  With XMill however, it becomes
more economical to choose XML over application specific data formats,
because the XML file is compressed with XMill better (up to half the
size) than the application specific file compressed with gzip.  We
discovered this surprising fact by converting several application
specific data formats to XML (including weblog data, protein meta
data, linguistic data), then compressing the original file with gzip,
and the XML file with XMill: the compressed XML file was always
smaller, up to a factor of two. Details are included in the
distribution at the Web site above.

MAILING LIST.  For updates on XMill, please subscribe to
xmill@r..., by sending an email to
majordomo@r..., with the body "subscribe xmill".


Regards,

   Hartmut Liefke  -- University of Pennsylvania, liefke@s...
   Dan Suciu       -- AT&T Labs, suciu@r...

xml-dev: A list for W3C XML Developers. To post, mailto:xml-dev@i...
Archived as: http://www.lists.ic.ac.uk/hypermail/xml-dev/ and on CD-ROM/ISBN 981-02-3594-1
To unsubscribe, mailto:majordomo@i... the following message;
unsubscribe xml-dev
To subscribe to the digests, mailto:majordomo@i... the following message;
subscribe xml-dev-digest
List coordinator, Henry Rzepa (mailto:rzepa@i...)

• Follow-Ups:
  • Re: Free Tool for Efficient XML Data Compression
    • From: Elliotte Rusty Harold <elharo@m...>

• Prev by Date: Re: XML parsing memory overhead concerns (fwd)
• Next by Date: SAX2: summary of Namespace-support arguments
• Previous by thread: Re: XML parsing memory overhead concerns (fwd)
• Next by thread: Re: Free Tool for Efficient XML Data Compression
• Index(es):
  • Date
  • Thread