SSDN - Memory problems using xQuery

XML Editor

Sign Up

Search

Options

Chat

Help

News

Log in

Not Logged in

Topic

Julio de la Vega

Subject: Memory problems using xQuery
Author: Julio de la Vega
Date: 08 Jan 2008 08:01 AM

Hi *,

I am having problems with memory in used with my xQuery development. When I process very big files, the amount of memory in used generates a java heap error.

Please find attached my xQuery development

Any ideas are welcome

Regards

PREINFORMEXQUERY_VERSION_preproduccion.xquery
xQuery development

Minollo I.

Subject: Memory problems using xQuery
Author: Minollo I.
Date: 08 Jan 2008 08:59 AM

What is the size of the input document that triggers the memory error? Have you tried increasing the memory settings used by the JVM in Stylus Studio? You can do that in the Tools > Options > Java Virtual Machine page, adding something like " -Xmx512m" to the "Parameters" field.

Julio de la Vega

Subject: Memory problems using xQuery
Author: Julio de la Vega
Date: 08 Jan 2008 09:45 AM

My test input documents are about 300 Mb and I know that I will have bigger files in my production environment (around 1Gb as input flat files)
I am running my development with DataDirect XQuery converter under java. I have setup Xmx parameter to more that 1GB but my java heap error appears when I test a big file.

Is there any scenario setting that can solve this issue?
Can you help me to undertand where my problem is?

Regards

Minollo I.

Subject: Memory problems using xQuery
Author: Minollo I.
Date: 08 Jan 2008 09:55 AM

Handling files that large with the XQuery you are using is a challenge. The kind of operations your XQuery is doing defeat most of the scalability optimizations that DataDirect XQuery tries to implement to avoid materializing in memory the whole input document.

Any chance you can email us at stylus-field-report@progress.com a (zipped) largish sample input file you are using, so that we can see if we can modify your XQuery to leverage the scalability features of DataDirect XQuery?

Julio de la Vega

Subject: Memory problems using xQuery
Author: Julio de la Vega
Date: 08 Jan 2008 10:06 AM

Ok. I will send to you an example input data file.
What actual xQuery elemement do you think that is generating my memory problems? How can I improve my scalability features?

Minollo I.

Subject: Memory problems using xQuery
Author: Minollo I.
Date: 08 Jan 2008 10:14 AM

...the reason I'm asking for a sample input file is to be able to answer those questions.

Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!

Go to Conference:

Log In Options Username: Password:

Site Map | Privacy Policy | Terms of Use | Trademarks

Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2016 All Rights Reserved.