[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

RE: XML not ideal for Big Data

  • From: "Koya, Suresh (Suresh Koya)" <suresh.koya@hp.com>
  • To: Mukul Gandhi <gandhi.mukul@gmail.com>, Simon St.Laurent<simonstl@s...>
  • Date: Thu, 3 Sep 2009 17:15:06 +0000

RE:  XML not ideal for Big Data
I  too agree with you. I guess the idea which started the markup movement was to make data human readable along with being machine readable. Someone should probably think once before XMLizing a 50 MB size stream, if any average person(I cannot) can read through a 50 MB document. The parsers are meant to be human interpreters for machines and optimized(fast) xml parsers are like speed readers. In this aspect the machines could be as (in)efficient as us. That is why the parsers limitation on data size always looked good to me. 
By the way, was there any information which tells what is the reasonable file size which a person can read trough and understand? I found some useless information from a google search or my google search criteria is inefficient. Whatever.. 

This is my own thought and the company I work for has nothing to do with it.

-----Original Message-----
From: Mukul Gandhi [mailto:gandhi.mukul@gmail.com] 
Sent: Thursday, September 03, 2009 9:38 AM
To: Simon St.Laurent
Cc: xml-dev@lists.xml.org
Subject: Re:  XML not ideal for Big Data

I somewhat agree to this article, about not using XML for very large sizes. I generally not like (or it doesn't work well with XML tools) working with XML's larger than, say 50 MB! But different people, may have different preferences.

But certainly XML is very valuable in smaller sizes (5 bytes to 50 MB I guess :)). We can think of useful existing applications of XML, like small sized messages that we send, configuration files for various purposes (EJB descriptors, Eclipse meta data and so on). Almost all kinds of tools produce XML in some form, for report generation, which can be transformed to various targets (HTML, PDF etc).

If I am given a huge XML document for consuming by my application, I have no choice to process and consume it :) But if I need to design a storage format, and a data model for large quantities of data (say in giga bytes), I would not like to store and model all the data as XML.
I would try to do it as a combination of XML and Relational format, perhaps. I would try to use XML, for schema's which change frequently.

The beauty of XML today is, that every modern software system understands XML, making XML as we all know, a great interoperability format.

On Thu, Sep 3, 2009 at 9:23 PM, Simon St.Laurent<simonstl@simonstl.com> wrote:
> Perhaps there were better ways to have made XML work with his problems...
> but I think on the whole he's right.
> http://dataspora.com/blog/xml-and-big-data/
> --
> Simon St.Laurent
> http://simonstl.com/

Mukul Gandhi


XML-DEV is a publicly archived, unmoderated list hosted by OASIS to support XML implementation and development. To minimize spam in the archives, you must subscribe before posting.

[Un]Subscribe/change address: http://www.oasis-open.org/mlmanage/
Or unsubscribe: xml-dev-unsubscribe@lists.xml.org
subscribe: xml-dev-subscribe@lists.xml.org List archive: http://lists.xml.org/archives/xml-dev/
List Guidelines: http://www.oasis-open.org/maillists/guidelines.php

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index]


Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
First Name
Last Name
Subscribe in XML format
RSS 2.0
Atom 0.3

Stylus Studio has published XML-DEV in RSS and ATOM formats, enabling users to easily subcribe to the list from their preferred news reader application.

Stylus Studio Sponsored Links are added links designed to provide related and additional information to the visitors of this website. they were not included by the author in the initial post. To view the content without the Sponsor Links please click here.

Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.