Saxon: Java heap space problem

[Sall, Kenneth B.]

Thank you again, Michael. That did the trick! No trouble with a 200 MB
file now.

 

Building tree for [filename] using class net.sf.sa

xon.tinytree.TinyBuilder

Tree built in 55735 milliseconds

Tree size: 10718474 nodes, 41335224 characters, 3246452 attributes

Execution time: 58609 milliseconds

 

---

I should add I was also able to use DataDirect's latest version of
Stylus Studio to load and process this huge file since my original
message.

 

Ken Sall
SAIC > ASC > RDEC > Columbia
410-953-7016 (office)
410-300-2997 (mobile)

________________________________

From: Michael Kay [mailto:http://x-query.com/mailman/listinfo/talk] 
Sent: Friday, June 08, 2007 6:05 PM
To: Sall, Kenneth B.; http://x-query.com/mailman/listinfo/talk
Subject: RE:  Saxon: Java heap space problem

 

This is a Java option, not a Saxon option. For the Sun JVM see

 

http://java.sun.com/j2se/1.5.0/docs/tooldocs/windows/java.html

 

Eg:

 

java -Xmx1024m net.sf.saxon.Query ....

 

Michael Kay

http://www.saxonica.com/

	 

	
________________________________


	From: Sall, Kenneth B. [mailto:http://x-query.com/mailman/listinfo/talk] 
	Sent: 08 June 2007 22:47
	To: Michael Kay; http://x-query.com/mailman/listinfo/talk
	Subject: RE:  Saxon: Java heap space problem

	Michael,

	 

	Thanks but I don't see this option on
http://www.saxonica.com/documentation/using-xquery/commandline.html nor
when I do "java -help".

	Is it available for Saxon 8.9J (free version)?

	 

	Ken Sall
	SAIC > ASC > RDEC > Columbia
	410-953-7016 (office)
	410-300-2997 (mobile)

	
________________________________


	From: Michael Kay [mailto:http://x-query.com/mailman/listinfo/talk] 
	Sent: Friday, June 08, 2007 5:28 PM
	To: Sall, Kenneth B.; http://x-query.com/mailman/listinfo/talk
	Subject: RE:  Saxon: Java heap space problem

	 

	How much heap space did you allocate?

	 

	My usual rule of thumb is 5x the raw document size, so this
should run if you allocate 1Gb (use the -Xmx option). That's an
apporximation of course, it's sometimes more, sometimes less.

	 

	Michael Kay

	http://www.saxonica.com/ 

		 

		
________________________________


		From: http://x-query.com/mailman/listinfo/talk
[mailto:http://x-query.com/mailman/listinfo/talk] On Behalf Of Sall, Kenneth B.
		Sent: 08 June 2007 20:52
		To: http://x-query.com/mailman/listinfo/talk
		Subject:  Saxon: Java heap space problem

		Hi,

		 

		When attempting to process a 200 MB file with Saxon 8.9J
(Java version 1.6.0_01), I run out of heap space. 

		 

		Building tree for file:/D:/PFA/PFA_200509302000_F.xml
using class net.sf.sa

		xon.tinytree.TinyBuilder

		Exception in thread "main" java.lang.OutOfMemoryError:
Java heap space

		        at
net.sf.saxon.tinytree.TinyTree.ensureNodeCapacity(TinyTree.java:203)

		        at
net.sf.saxon.tinytree.TinyTree.addNode(TinyTree.java:292)

		 

		Since I'm already using the default "tiny tree" model,
and having closed down other applications, short of adding more physical
memory, is there anything else I can do? If it matters, this large file
is only 2 "lines": the XML declaration and the rest of the file.

		 

		Is there anyway of getting a ballpark handle on the max
size of file I can process with Saxon (and Java) if my physical memory
is say "N" MB?

		 

		Total Physical Mem = 2.048 GB

		Available Physical Mem = 1.22 GB

		Total Virtual Mem = 2.00 GB

		Available Virtual Mem = 1.96 MB

		Page File Space = 3.85 GB

		 

		Thanks!

		 

		Kenneth B. Sall

		XML Data and Systems Analyst
		Advanced Systems and Concepts
		Science Applications International Corp. (SAIC)
		7125 Columbia Gateway Dr., Suite 250
		Columbia, MD  21046
		410-953-7016 (office)

		410-300-2997 (mobile)

		 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://x-query.com/pipermail/talk/attachments/20070608/079e6cc1/attachment.htm