XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Conferences Close Tree View
+ Stylus Studio Feature Requests (1192)
+ Stylus Studio Technical Forum (14621)
+ Website Feedback (249)
- XSLT Help and Discussion (7625)
-> + Replacing commas with a blank (6)
-> + Grouping very urgent . (2)
-> + xsl node number (3)
-> + Wordml intelligence (6)
-> + Preview and backmapping for wo... (5)
-> + XSLT - find line numbers of di... (2)
-> + The last five bytes of a varia... (7)
-> + simple problem but i'm a bit t... (3)
-> + H plz help me (2)
-> + XSLT : Very Urgent Requirement (7)
-> + comparing two xml files (3)
-> + Support for xsl created from w... (4)
-> + Wildcard Param (3)
-> - XSLT OutOfMemoryError (3)
-> ->XSLT OutOfMemoryError
-> ->XSLT OutOfMemoryError
-> + How can I output the filename ... (7)
-> + How do I strip out a comma ast... (8)
-> + xslt current-dateTime() not re... (2)
-> + Exceed the maximum recursion d... (8)
-> + Saxon9 "java.net.ConnectExcept... (2)
-> - Help Required (1)
-- Previous [601-620] [621-640] [641-660] Next
+ XQuery Help and Discussion (2017)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (364)
+ Stylus Studio Announcements (113)
Topic  
Postnext
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 09 May 2008 07:14 PM

I get a "OutOfMemoryError: Java heap space" when transforming a big XML file of 500 MB.
I use JDK 1.5 default XSLTC processor. I have set the maximum java heap size to 1 giga.


Is this problem related to XSLTC? Should I use another transformer ?
How can I process files of this size?



My code:

javax.xml.transform.TransformerFactory tFactory = javax.xml.transform.TransformerFactory.newInstance();

InputStream xslInputstream = this.getClass().getClassLoader().getResourceAsStream(xsl);

Transformer transformer = tFactory.newTransformer(new StreamSource(xslInputstream));

transformer.transform(new StreamSource(inputStream), new StreamResult(outputStream));


DocumentOutOfMemoryError.txt
Stacktrace

Postnext
Tony LavinioSubject: XSLT OutOfMemoryError
Author: Tony Lavinio
Date: 10 May 2008 05:23 PM
While if you write your XSLT very carefully and use Saxon 9,
theoretically you could process it, we know of no Java-based
XSLT engine that will handle a file anywhere near that large.
There is some documentation at http://www.saxonica.com/ that
might help a little in some specific cases.

Consider that XSLT generally works on an in-memory representation
of the file, and the in-memory version of an XML document is
typically 4-10x the size on disk.

You might be able to process it using DataDirect XQuery, which
is designed to work with larger files and works in a streaming
fashion.

Posttop
ed beSubject: XSLT OutOfMemoryError
Author: ed be
Date: 13 May 2008 08:19 AM
Thanks for the info.

Are there other forum members that have experience in transforming big files with open source XSLT implementations ?

   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.