[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Processing huge XML files

• To: xml-dev <xml-dev@l...>
• Subject: Processing huge XML files
• From: Thomas Lee <ytlee@c...>
• Date: Fri, 11 Oct 2002 09:43:16 +0800
• Organization: CECID, HKU
• User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.0.1) Gecko/20020823 Netscape/7.0 (BDP)

Hi all,

We need to process very large XML files (up to a few ten MB). So we 
can't process the whole file with DOM in memory. We are prepared to use 
SAX to parse a large XML file and store into our data structure in the 
disk (propietary data structure or RDBMS). We'll also provide a set of 
APIs for access the contents in the XML file. Now the XML content change 
is not required.

However, instead of developing a customized solution, I'd like to know 
if there is any existing tools and library handling large XML files in disk.

Regards,
Thomas

-- 
   Thomas Y.T. LEE
   Chief Technology Officer
   Center for E-Commerce Infrastructure Development (CECID)
   Department of Computer Science and Information Systems
   The University of Hong Kong
   E-mail: ytlee@c...  URL: http://www.cecid.hku.hk
   Tel: +852 22415388  Fax: +852 25474611
   Room 301, Chow Yei Ching Building
   Pokfulam Road, Hong Kong SAR, China

• Follow-Ups:
  • Re: Processing huge XML files
    • From: Barrie Slaymaker <barries@s...>
  • RE: Processing huge XML files
    • From: "Michael Kay" <michael.h.kay@n...>
  • Re: Processing huge XML files
    • From: Robin LaFontaine <robin.lafontaine@d...>
  • Re: Processing huge XML files
    • From: ht@c... (Henry S. Thompson)
  • Re: Processing huge XML files
    • From: "Jeff Greif" <jgreif@a...>
  • Re: Processing huge XML files
    • From: Mike Champion <mc@x...>

• Prev by Date: Re: Great piece on RSS
• Next by Date: Re: Processing huge XML files
• Previous by thread: RE: XLink question re: arc duplication
• Next by thread: Re: Processing huge XML files
• Index(es):
  • Date
  • Thread