[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: Scatter/gather pattern [was: New XPipe Presentation Availa

• To: "Thomas B. Passin" <tpassin@c...>, xml-dev@l...
• Subject: Re: Scatter/gather pattern [was: New XPipe Presentation Available]
• From: Sean McGrath <sean.mcgrath@p...>
• Date: Fri, 22 Feb 2002 12:01:47 +0000
• In-reply-to: <000a01c1bb64$1f163f80$0bf13044@tbp>
• References: <5.1.0.14.2.20020221084821.01c87ab8@p...><3C7504D8.7AD2E4CB@m...>

At 00:45 22/02/2002 -0500, Thomas B. Passin wrote:
>What is probably the best known application of a scatter-gather pattern
>occurs, not in markup, not in software engineering, but in physics (or
>electrical engineering depending on how you look at things).  I'm referring
>to the famous Fast Fourier Transform.  The FFT lets you analyze the
>frequency content of a waveform in time O[n log n) instead of O[n^2], which
>a straightforward approach (the Discrete Fourier Transform) needs, where n
>is the number of points in the waveform.
>
>The art is in decomposing the problem and putting it back together, and I'm
>sure that remains a constant over the span of scatter-gather solutions.

Yes.


>Conversely, scatter-gather won't be worth the effort unless it yields
>similar savings.

Experience with Scatter/Gather in XML processing has shown that
the benefits are well worth the effort more often than not.
Any developer who has chucked an XSLT/DOM solution in favour
of a SAX/Lexical solution because of memory constraints should
consider Scatter/Gather rather than a rewrite.

The challenge for XPipe is to make the application of the scatter/gather
pattern a no-brainer. We are working on that bit. (And also actively
seeking discussion on the idea of document fulcra and how best
to find these animals in XML corpora.)

Sean

• References:
  • Scatter/gather pattern [was: New XPipe Presentation Available]
    • From: "Roger L. Costello" <costello@m...>
  • Re: Scatter/gather pattern [was: New XPipe PresentationAvailable]
    • From: "Thomas B. Passin" <tpassin@c...>

• Prev by Date: Re: SOAP-RPC and REST and security
• Next by Date: Re: SOAP-RPC and REST and security
• Previous by thread: Re: Scatter/gather pattern [was: New XPipe PresentationAvailable]
• Next by thread: On the use of HTTP as a Substrate
• Index(es):
  • Date
  • Thread