XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
+ Stylus Studio Technical Forum (14621)
+ Website Feedback (249)
- XSLT Help and Discussion (7625)
-> + Use of before and after string (3) Sticky Topic
-> - How do I substitute element ty... (1)
-> + How does one add working days ... (4)
-> - Help, I have existing XLT and... (1)
-> + Need help on XSLT issue - (2)
-> + EDI to XML Conversion (7)
-> - XML To JSON Conversion using X... (1)
-> + Formatting Paragraphs to same ... (2)
-> - Grouping of records (1)
-> + Problems with xsd 1.1 (4)
-> + XML to HL7 mapping (3)
-> + XSLT 3 and Iterate (2)
-> + XSL-FO to PDF preview (3)
-> + java.lang.RuntimeException: Er... (2)
-> + Create Acroforms with Stylus X... (2)
-> + How to change XSLT parameter s... (3)
-> + how to change format of the da... (2)
-> + Search "Next 8 Results " doesn... (2)
-> - Support for Git (1)
-> + newbee (8)
-- [1-20] [21-40] [41-60] Next
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 09 May 2008 07:14 PM

I get a "OutOfMemoryError: Java heap space" when transforming a big XML file of 500 MB.
I use JDK 1.5 default XSLTC processor. I have set the maximum java heap size to 1 giga.


Is this problem related to XSLTC? Should I use another transformer ?
How can I process files of this size?



My code:

javax.xml.transform.TransformerFactory tFactory = javax.xml.transform.TransformerFactory.newInstance();

InputStream xslInputstream = this.getClass().getClassLoader().getResourceAsStream(xsl);

Transformer transformer = tFactory.newTransformer(new StreamSource(xslInputstream));

transformer.transform(new StreamSource(inputStream), new StreamResult(outputStream));


DocumentOutOfMemoryError.txt
Stacktrace

Postnext
Tony LavinioSubject: XSLT OutOfMemoryError
Author: Tony Lavinio
Date: 10 May 2008 05:23 PM
While if you write your XSLT very carefully and use Saxon 9,
theoretically you could process it, we know of no Java-based
XSLT engine that will handle a file anywhere near that large.
There is some documentation at http://www.saxonica.com/ that
might help a little in some specific cases.

Consider that XSLT generally works on an in-memory representation
of the file, and the in-memory version of an XML document is
typically 4-10x the size on disk.

You might be able to process it using DataDirect XQuery, which
is designed to work with larger files and works in a streaming
fashion.

Posttop
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 13 May 2008 08:19 AM
Thanks for the info.

Are there other forum members that have experience in transforming big files with open source XSLT implementations ?

   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.