Subject:Memory problems using xQuery Author:Julio de la Vega Date:08 Jan 2008 08:01 AM
Hi *,
I am having problems with memory in used with my xQuery development. When I process very big files, the amount of memory in used generates a java heap error.
Subject:Memory problems using xQuery Author:Minollo I. Date:08 Jan 2008 08:59 AM
What is the size of the input document that triggers the memory error? Have you tried increasing the memory settings used by the JVM in Stylus Studio? You can do that in the Tools > Options > Java Virtual Machine page, adding something like " -Xmx512m" to the "Parameters" field.
Subject:Memory problems using xQuery Author:Julio de la Vega Date:08 Jan 2008 09:45 AM
My test input documents are about 300 Mb and I know that I will have bigger files in my production environment (around 1Gb as input flat files)
I am running my development with DataDirect XQuery converter under java. I have setup Xmx parameter to more that 1GB but my java heap error appears when I test a big file.
Is there any scenario setting that can solve this issue?
Can you help me to undertand where my problem is?
Subject:Memory problems using xQuery Author:Minollo I. Date:08 Jan 2008 09:55 AM
Handling files that large with the XQuery you are using is a challenge. The kind of operations your XQuery is doing defeat most of the scalability optimizations that DataDirect XQuery tries to implement to avoid materializing in memory the whole input document.
Any chance you can email us at stylus-field-report@progress.com a (zipped) largish sample input file you are using, so that we can see if we can modify your XQuery to leverage the scalability features of DataDirect XQuery?
Subject:Memory problems using xQuery Author:Julio de la Vega Date:08 Jan 2008 10:06 AM
Ok. I will send to you an example input data file.
What actual xQuery elemement do you think that is generating my memory problems? How can I improve my scalability features?