[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message] Re: Processing large XML Documents [> 50MB]
Thanks everyone. On Wed, Feb 24, 2010 at 5:20 AM, Mike Odling-Smee <mike.odlingsmee@xxxxxxxxxxxxxx> wrote: >>> a) assemble around 30-40 XML documents [each with a common >>> header and its own lines] into one single XML document, with >>> the common header and all the lines >>> b) Update the assembled document in specific locations >>> c) generate multiple XML document fragments from the huge XML >>> document based on query criteria. Each XML frgment is created >>> by mapping specific fields in the big document. Each document >>> is created for a specific key element value in the huge document. >>> > > You could take a multi-pass approach which would not be too dissimilar > to what you do currently: > > First pass > A variation on step a) Create a single (more lightweight) XML file > that only contains the necessary meta-data and resolved relationships > from your 30-40 XML documents (equivalent to a database view if you > like). > b) As before but only briefly load XML that is pertinent to the update > using the results from step a) as a map > c) Again as before, but only load the XML that is required or > alternatively just use the more lightweight XML created in step a) if > it contains all the information you need > > Whether or not this approach will work for you depends on your > detailed requirements. > > Alternatively (if you have not already tried it) you might want to try > to optimise the performance of your existing XSLT - for instance by > using xsl:key. > > Kind regards, > > Michael > www.xml-solutions.com > > -- Shift to the left, shift to the right! Pop up, push down, byte, byte, byte! -Ramkumar Menon A typical Macroprocessor
|
PURCHASE STYLUS STUDIO ONLINE TODAY!Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced! Download The World's Best XML IDE!Accelerate XML development with our award-winning XML IDE - Download a free trial today! Subscribe in XML format
|