Re: real big sourcefile (300MB)

Play the video

Subject: Re: real big sourcefile (300MB)
From: Jeff Kenton <jeffrey.kenton@xxxxxxxxxxx>
Date: Sun, 13 Jun 2004 07:11:18 -0400

Konrad,

Typically, most XSLT processors read in your entire source file and build an internal representation in memory. This is often 3-5 times bigger than the original source. In your case, we're talking about 1 gigabyte, or maybe 1.5 gigabyte, of memory. So, your 512MB machine is probably swapping like crazy. Can you hear the disk working?

Try breaking your problem into pieces. Or, if the processing is simple, try writing your own SAX handler that can read the input once through and process it without needing the entire data structure in memory at once.

Good luck.

jeff

Konrad Mader wrote:

Hi,

I try to transform a 300MB-xml-file in a html-file with the xalan-c++ (1.8). My System (Intel P4, 2.8GHz, 512MB-ram, Win2000) works for days without result.

A 30MB-xml-file is transformed in few seconds.

Is it posibly to handle a 300MB-Source? If yes: how?
thanks!
Konrad
--+------------------------------------------------------------------
XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe@xxxxxxxxxxxxxxxxxxxxxx>
--+--

--

-------------------------------------------------------------------------
=    Jeff Kenton      Consulting and software development               =
=                     http://home.comcast.net/~jeffrey.kenton           =
-------------------------------------------------------------------------

Current Thread
real big sourcefile (300MB) Konrad Mader - Sun, 13 Jun 2004 12:10:15 +0200 Jeff Kenton - Sun, 13 Jun 2004 07:11:18 -0400 <=

<- Previous	Index	Next ->
real big sourcefile (300MB), Konrad Mader	Thread	Stumped on why a field isn't showin, Deirdre Saoirse Moen
real big sourcefile (300MB), Konrad Mader	Date	Stumped on why a field isn't showin, Deirdre Saoirse Moen
	Month

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Subscribe in XML format

RSS 2.0
Atom 0.3

XML Editor - Download a 15 Day Free Trial Now >

See What's New in Stylus Studio >

Buy Stylus Studio - XML Editor - Now >