[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: I processed a 3GB XML file ... using XSLT streaming

• From: Dimitre Novatchev <dnovatchev@gmail.com>
• To: liam@w3.org
• Date: Fri, 13 Sep 2013 12:28:24 -0700

> The point of streaming is (of course) being able to do such things
> without using much memory, even if it's slower. Not everyone has 96G, or
> even 16G of memory available... :-)


Absolutely true.

Also, there could be cases when the XML data is generated in real time
continuously and non-stop,  and must be processed again in real time.
In such scenarios even terabytes of RAM wouldn't help.


Cheers,
Dimitre

On Fri, Sep 13, 2013 at 12:14 PM, Liam R E Quin <liam@w3.org> wrote:
> On Fri, 2013-09-13 at 20:53 +0200, Hermann Stamm-Wilbrandt wrote:
>> I did give your non-streaming stylesheet (B) a try (A).
>> Slight modifications were necessary to get back to XSLT 1.0
>> (eq -> = , doc -> document).
>> 16GB of memory were used (17851470K-1067694K), (D).
>
> The point of streaming is (of course) being able to do such things
> without using much memory, even if it's slower. Not everyone has 96G, or
> even 16G of memory available... :-)
>
> Liam
>
> --
> Liam Quin - XML Activity Lead, W3C, http://www.w3.org/People/Quin/
> Pictures from old books: http://fromoldbooks.org/
> Ankh: irc.sorcery.net irc.gnome.org freenode/#xml
>
>
> _______________________________________________________________________
>
> XML-DEV is a publicly archived, unmoderated list hosted by OASIS
> to support XML implementation and development. To minimize
> spam in the archives, you must subscribe before posting.
>
> [Un]Subscribe/change address: http://www.oasis-open.org/mlmanage/
> Or unsubscribe: xml-dev-unsubscribe@lists.xml.org
> subscribe: xml-dev-subscribe@lists.xml.org
> List archive: http://lists.xml.org/archives/xml-dev/
> List Guidelines: http://www.oasis-open.org/maillists/guidelines.php
>



-- 
Cheers,
Dimitre Novatchev
---------------------------------------
Truly great madness cannot be achieved without significant intelligence.
---------------------------------------
To invent, you need a good imagination and a pile of junk
-------------------------------------
Never fight an inanimate object
-------------------------------------
To avoid situations in which you might make mistakes may be the
biggest mistake of all
------------------------------------
Quality means doing it right when no one is looking.
-------------------------------------
You've achieved success in your field when you don't know whether what
you're doing is work or play
-------------------------------------
Facts do not cease to exist because they are ignored.
-------------------------------------
Typing monkeys will write all Shakespeare's works in 200yrs.Will they
write all patents, too? :)
-------------------------------------
I finally figured out the only reason to be alive is to enjoy it.

• Follow-Ups:
  • Re: I processed a 3GB XML file ... using XSLT streaming
    • From: Peter Hunsberger <peter.hunsberger@gmail.com>

• References:
  • I processed a 3GB XML file ... using XSLT streaming
    • From: "Costello, Roger L." <costello@mitre.org>
  • Re: I processed a 3GB XML file ... using XSLT streaming
    • From: Hermann Stamm-Wilbrandt <STAMMW@de.ibm.com>
  • Re: I processed a 3GB XML file ... using XSLT streaming
    • From: Liam R E Quin <liam@w3.org>