XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Show tree view Topic
Topic Page 1 2 3 4 5 6 7 8 9 Go to previous topicPrev TopicGo to next topicNext Topic
Postnext
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 09 May 2008 07:14 PM

I get a "OutOfMemoryError: Java heap space" when transforming a big XML file of 500 MB.
I use JDK 1.5 default XSLTC processor. I have set the maximum java heap size to 1 giga.


Is this problem related to XSLTC? Should I use another transformer ?
How can I process files of this size?



My code:

javax.xml.transform.TransformerFactory tFactory = javax.xml.transform.TransformerFactory.newInstance();

InputStream xslInputstream = this.getClass().getClassLoader().getResourceAsStream(xsl);

Transformer transformer = tFactory.newTransformer(new StreamSource(xslInputstream));

transformer.transform(new StreamSource(inputStream), new StreamResult(outputStream));


DocumentOutOfMemoryError.txt
Stacktrace

Postnext
Tony LavinioSubject: XSLT OutOfMemoryError
Author: Tony Lavinio
Date: 10 May 2008 05:23 PM
While if you write your XSLT very carefully and use Saxon 9,
theoretically you could process it, we know of no Java-based
XSLT engine that will handle a file anywhere near that large.
There is some documentation at http://www.saxonica.com/ that
might help a little in some specific cases.

Consider that XSLT generally works on an in-memory representation
of the file, and the in-memory version of an XML document is
typically 4-10x the size on disk.

You might be able to process it using DataDirect XQuery, which
is designed to work with larger files and works in a streaming
fashion.

Posttop
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 13 May 2008 08:19 AM
Thanks for the info.

Are there other forum members that have experience in transforming big files with open source XSLT implementations ?

 
Topic Page 1 2 3 4 5 6 7 8 9 Go to previous topicPrev TopicGo to next topicNext Topic
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.