[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: Max size?

Subject: Re: Max size?
From: Johannes Döbler <jd@xxxxxxxxxxxxxx>
Date: Thu, 09 Jan 2003 23:42:28 +0100
johannes d bler
I think it might be interesting for the discussion:

I developed an extension jd.bigxml [1] for my XSLT processor jd.xslt [2] to process arbitrary large XML documents.

It is implemented on the tree model "layer" using some sort of paging mechanism: Instead of building an object tree of the whole document, a temporary index file is created and only the current accessed parts of the document are loaded into memory.

Advantage: No stylesheet information or analysis is required. In fact, the core XSLT engine is completely agnostic of the tree model implementation and has not been changed in any way to support the bigxml version.

To give some numbers from early experiments:
Transformation of a 35 MB document showed on my computer (equipped with 256 MB RAM)
- jd.xslt with the normal tree model: done in 26 seconds, using 254 MB peek memory
- jd.xslt with the big tree model: done in 27 seconds, using 13 MB peek memory
- Xalan and other Java processors aborted with a OutOfMemoryError (when invoked from their standard commandline interface)


regards,
Johannes Döbler

[1] http://www.aztecrider.com/bigxml/
[2] http://www.aztecrider.com/xslt/


XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list



Current Thread

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
Email
First Name
Last Name
Company
Subscribe in XML format
RSS 2.0
Atom 0.3
Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.