Re: coping with huge xml-saxon

On Mon, Jun 16, 2003 at 06:01:15PM +0200, Johannes Döbler wrote:
> 
> 600 MB will most probably kill every classic XSLT processor, since they all 
> try to load the document into memory.
> You can do the following:

So what exactly is the memory limit for XSLT transformations? I know
that Michale Kay in his book mentions that documents larger than 1 or 2
MB cannot be processed by an XSLT processor, because, as you say, the
processor loads them into memory.

However, why his this limit so low? On my box I have 256 MB of memory.
It is not uncommon for a new machine to have 500 MB of memory--or even
double that amount.

It seem that if you have 256 MB of memory, you ought to be able to
handle a document of around 50 MB. (I think the processor actually
requires something like 4 times the size of the document--or was it 10?)

I see the memory as the only drawback for xslt transformations. After
all, I have documents that are around 1 MB in size, and I can easily see
real documents being many times that size

thanks

Paul

> 
> Write a SAX-ContentHandler to transform your document
> 
> Use STX (Streaming Transformations: http://stx.sourceforge.net/) instead of 
> XSLT
> 
> Try jd.bigxml (http://www.aztecrider.com/bigxml/): It is a XPath model 
> implementation for huge XML documents and can be used with the
> XSLT Processor jd.xslt to transform such documents. If you give it at try 
> then please let me know whether it worked.
> 
> regards,
> Johannes
> 
> 
> >Dear all,
> >I have a problem which i cant figure out how to get round. I have an XML
> >that is as big as 600 Mg and everything fails!!!
> >I am using saxon and running this under win2k Machine. It reports of memory
> >out of stack and i tried increasing the memory to the JVM with the JVM
> >parameter and apparently we  can not increase the memory to more than a
> >certain limit.I would appreciate if someone can please let me know how we
> >can solve this
> >Thanks
> >
> >
> > XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
> 
> 
> XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list

-- 

************************
*Paul Tremblay         *
*phthenry@xxxxxxxxxxxxx*
************************

 XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list