[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message] RE: Large transforms (was Re: GByte Transforms)
From: Jeff Kenton There are people who have 100 megabyte product catalogs in XML files. So, there are several questions you can ask here. First, what does it take for an XSLT processor to handle XML too big to live in memory all at once? [ That was Kevin Jones's question. ] Second, what other techniques will help beat the problem? XML databases? What else? >From a systems perspective there are more problems. 1. Serving the data. If the source is a database, access time, encoding, escaping specials. Update integration if an issue. 2. XML database or 'other', when to choose an XML database (one of my current problems). I've recently been persuaded its not such an easy decision. 3. Kevins arena, processing it, then if needed, processing it fast enough for the customer. What business process needs what percentage of the data in what timeframe/regularity. What are the alternatives to processing the whole n gig chunk? I guess this repeats the 'how to process a big file' debate at another level. How can I chunk the data without losing integrity for appropriate processing, XSLT or otherwise. XSLT may play a part in this data partitioning, though if its stored in a well designed database, I'd have thought other tools more appropriate? 4. Finally serving the result of processing into the right place/time with the right encoding. regards DaveP ** snip here ** -- DISCLAIMER: NOTICE: The information contained in this email and any attachments is confidential and may be privileged. If you are not the intended recipient you should not use, disclose, distribute or copy any of the content of it or of any attachment; you are requested to notify the sender immediately of your receipt of the email and then to delete it and any attachments from your system. RNIB endeavours to ensure that emails and any attachments generated by its staff are free from viruses or other contaminants. However, it cannot accept any responsibility for any such which are transmitted. We therefore recommend you scan all attachments. Please note that the statements and views expressed in this email and any attachments are those of the author and do not necessarily represent those of RNIB. RNIB Registered Charity Number: 226227 Website: http://www.rnib.org.uk
|
PURCHASE STYLUS STUDIO ONLINE TODAY!Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced! Download The World's Best XML IDE!Accelerate XML development with our award-winning XML IDE - Download a free trial today! Subscribe in XML format
|