[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

RE: Large transforms (was Re: GByte Transforms)

Subject: RE: Large transforms (was Re: GByte Transforms)
From: David.Pawson@xxxxxxxxxxx
Date: Fri, 4 Jun 2004 14:41:46 +0100
xslt very large files
    From: Jeff Kenton 

    There are people who have 100 megabyte product catalogs in 
    XML files. 
    
    So, there are several questions you can ask here.  First, 
    what does it take for an XSLT processor to handle XML too 
    big to live in memory all at once? [ That was Kevin Jones's 
    question. ]  Second, what other techniques will help beat 
    the problem? XML databases? What else?

>From a systems perspective there are more problems.
1. Serving the data.
If the source is a database, access time, encoding, escaping specials.
Update 
integration if an issue.
2. XML database or 'other', when to choose an XML database (one of my
current problems).
I've recently been persuaded its not such an easy decision.
3. Kevins arena, processing it, then if needed, processing it fast enough
for the customer.
  What business process needs what percentage of the data  in what
timeframe/regularity.
  What are the alternatives to processing the whole n gig chunk?
I guess this repeats the 'how to process a big file' debate at another
level.
How can I chunk the data without losing integrity for appropriate
processing, XSLT
or otherwise. XSLT may play a part in this data partitioning, though if its
stored
in a well designed database, I'd have thought other tools more appropriate?
4. Finally serving the result of processing into the right place/time with 
the right encoding.

regards DaveP

** snip here **

-- 
DISCLAIMER: 

NOTICE: The information contained in this email and any attachments is 
confidential and may be privileged. If you are not the intended 
recipient you should not use, disclose, distribute or copy any of the 
content of it or of any attachment; you are requested to notify the 
sender immediately of your receipt of the email and then to delete it 
and any attachments from your system. 

RNIB endeavours to ensure that emails and any attachments generated by 
its staff are free from viruses or other contaminants. However, it 
cannot accept any responsibility for any  such which are transmitted.
We therefore recommend you scan all attachments. 

Please note that the statements and views expressed in this email and 
any attachments are those of the author and do not necessarily represent 
those of RNIB. 

RNIB Registered Charity Number: 226227 

Website: http://www.rnib.org.uk 

Current Thread

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
Email
First Name
Last Name
Company
Subscribe in XML format
RSS 2.0
Atom 0.3
Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.