XML Editor
Sign up for a WebBoard account Sign Up Keyword Search Search More Options... Options
Chat Rooms Chat Help Help News News Log in to WebBoard Log in Not Logged in
Conferences Close Tree View
+ Stylus Studio Feature Requests (1146)
- Stylus Studio Technical Forum (14176)
-> + page break (4)
-> + name attribute of wsdl:fault e... (3)
-> + Cannot use my custom converter (3)
-> + java.lang.ClassNotFoundExcepti... (16)
-> + Witch product to buy (2)
-> + Trial version giving errors (2)
-> + Building and Integrating modul... (2)
-> + How to deploy pipeline (4)
-> + Is it possible to create xml f... (4)
-> + XML - CSV - XML Help! (2)
-> - xml file with many xsl style s... (1)
-> + Crash when using XML with DOCT... (2)
-> + Calling .Net classes from XSL ... (6)
-> + datadirect coverter result dif... (4)
-> + .net ConverterFactory().Create... (2)
-> + Dynamically created xsl used i... (4)
-> + Help with XSD attributes (3)
-> + Duplicated XML tag name in XML... (2)
-> + XML Publisher Repeater Bug wit... (4)
-> + HTML / FO selection (2)
-> + Command line interface to gene... (2)
-> + Provider org.apache.xerces.jax... (3)
-> + Problems with xsl:variable (2)
-> + any way to stop auto declarati... (2)
-> + Holding information in memory (9)
-> + Error whenever we try to read ... (4)
-> + Evaluation Versio Stylus Studi... (3)
-> + Convert linefeed-separated tex... (2)
-> + Transferring Stylus Studio fro... (3)
-> + Activation working on only one... (4)
-> + Populating Database from XML (2)
-> + Inserting Annotation (3)
-> + Project Window (2)
-> + DTD to Schema conversion gener... (2)
-> - Can't add multiple faults to a... (1)
-> + Soap fault name element (2)
-> + xml files supported outside of... (2)
-> + how to allow null values for d... (2)
-> + xml report query (5)
-> + Stylus Studio automatically ad... (3)
-> + Can we can stylus studio autom... (2)
-> + is it possible to insert into ... (3)
-> + Java Heap Space error (4)
-> + custom validation engines (3)
-> + W3C schema for enumerated taxo... (3)
-> + Using Stylus to generate elect... (2)
-> + WSDL editor and drop downs in ... (2)
-> + XSLT Mapper "forgetting" setti... (2)
-> + StylusStudio Crash: Error: Get... (7)
-> + Error in installation (2)
-> + Applying constraints & naming ... (5)
-> + Windows Installer prevents ins... (5)
-> + XML Schema to XML producing in... (8)
-> + calling javascript function in... (2)
-> + Repairin .xml file (2)
-> + HIgh CPU on a laptop after hib... (2)
-> - conditional rendering in XSL.. (1)
-> + Way to replace codes by labels... (4)
-> + Strange 'invisible' characters (4)
-> + syntax (2)
-> + Problem using mySQL (2)
-> + accessing Javascript variable ... (2)
-> + problem when openning files (2)
-> + Free Form Text (2)
-> + Cant open the database (4)
-> + Problem using MS Access (4)
-> + element type must not contain ... (3)
-> + XML to .txt file (7)
-> + Modifying a XSL-FO report (5)
-> + Retrievning multiple values...... (2)
-> + does Stylus Enterprise work wi... (2)
-> + MSSQL to 837P conversion (4)
-> + Generating XML files accesing ... (6)
-> + How to bold text using XSL (6)
-> + Different heading based on pag... (3)
-> + Code folding (2)
-> + Bad param=value pair on comman... (2)
-> + Saving an XML file (2)
-> + stylus adding random non print... (2)
-> + Displaying Base64Binary as Ima... (6)
-> - probleme de representation d'i... (1)
-> + SS 2008 error message not disp... (8)
-> + XQuery external variable conve... (4)
-> + encodings available (3)
-> + stand-alone application file n... (4)
-> + Windows Installer Dialog Box a... (4)
-> + Block search and replace (2)
-> + Problem with validation (3)
-> + ISA12 vs GS08 (5)
-> + Web Service Call failure... an... (11)
-> + Quotes in xpath query (3)
-> + Java Built-in processor no lon... (6)
-> + Dynamic input and output names (8)
-> + Java built-in parser (3)
-> + Contains an invalid path (2)
-> + Wizard XML Schema to XML (2)
-> + XML to EDI (14)
-> + Computer with original install... (2)
-> + using Custom Tool - passing ar... (3)
-> + Non-printable special characte... (3)
-- Previous [901-920] [921-940] [941-960] Next
+ Website Feedback (244)
+ XSLT Help and Discussion (7514)
+ XQuery Help and Discussion (1892)
+ Stylus Studio FAQs (159)
+ Stylus Studio Code Samples & Utilities (361)
+ Stylus Studio Announcements (113)
Topic  
Postnext
Lee HumphriesSubject: Memory hogging
Author: Lee Humphries
Date: 24 Jul 2003 10:21 PM
Back to one of my old complaints (nag, nag, nag ...)

I've got a very simple XSLT that stuffs two XML files into a container XML.

I just tried running it using the Stylus internal XSLT processor (5.0 build 127b) and it consumed over a Gig of RAM (mostly virtual - real slow - thrash that disk) trying to join together a 27Meg file with a 4.5Meg file.

Now I know the DOM can consume one order of magnitude more RAM than the size of the file. But both of these files had simple structures (although neither had a schema defined), so the DOM shouldn't be that hungry.

So how does 27 + 4.5 = 1024+ ?

Regards, Lee

Postnext
Minollo I.Subject: Re: Memory hogging
Author: Minollo I.
Date: 24 Jul 2003 10:39 PM
It's surely not the DOM which is causing the memory consumption you are
seeing. More likely it's a matter of output handler and/or of large XPath
expressions/XSLT variables.

Would it be possible for you to send us a testcase, maybe working on a
smaller version of the XML documents?

Minollo

Postnext
Lee HumphriesSubject: Re: Memory hogging
Author: Lee Humphries
Date: 25 Jul 2003 12:25 AM
Here's the XSLT in question - as you can it's pretty tiny. The file that it includes and throws into a variable is the 4.5Meg file.

To test it just take any two XML files, change the file name in the document function to match one of the files and supply the other as the scenario test case.

Regards, Lee


ApplicationExportReprocess1.xsl
Tiny Excess El Tea

Postnext
Minollo I.Subject: Re: Memory hogging
Author: Minollo I.
Date: 25 Jul 2003 09:16 AM
Thanks Lee.
We'll look into this.

Minollo

Posttop
Lee HumphriesSubject: Re: Memory hogging
Author: Lee Humphries
Date: 27 Jul 2003 07:46 PM
Hi Minollo,

One reason why I assumed your implementation of the DOM may be involved is that we've experienced apparently similar issues with MSXML 4.0

We had been initially using the MSXML DOM when importing and processing some larger XML files (from 800kb to 60Mb) however we found it unbelievably slow, and it got exponentially slower (roughly) based on the number of elements in the XML file.

So we switched to using SAX.

Later though, I wanted to eliminate some of the handcoded validation we had done for our SAX implementation in favour of using an XSD, as the SAX based validation also seemed to be taking too long.

So I set up a DOM instance with the XSD applied against it first, then imported the XML. Now it runs a hell of a lot faster (about 3 orders of magnitude faster) and load time appears to be linear with respect to the number of elements, memory consumption is also drastically reduced.

That's why I was wondering whether your DOM implementation may be suffering with these large files not having any schemas defined against them.

Regards, Lee

   
Download A Free Trial of Stylus Studio 6 XML Professional Edition Today! Powered by Stylus Studio, the world's leading XML IDE for XML, XSLT, XQuery, XML Schema, DTD, XPath, WSDL, XHTML, SQL/XML, and XML Mapping!  
go

Log In Options

Site Map | Privacy Policy | Terms of Use | Trademarks
Stylus Scoop XML Newsletter:
W3C Member
Stylus Studio® and DataDirect XQuery ™are from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2011 All Rights Reserved.