[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: XML-enabled databases, XQuery APIs

• To: Elliotte Harold <elharo@m...>
• Subject: Re: XML-enabled databases, XQuery APIs
• From: Robert Koberg <rob@k...>
• Date: Fri, 15 Apr 2005 06:29:31 -0700
• Cc: Ken North <kennorth@s...>, xml-dev@l...
• In-reply-to: <425F9008.4030304@m...>
• References: <003001c54133$ae25d660$1601a8c0@DURANTE> <425F9008.4030304@m...>
• User-agent: Mozilla Thunderbird 1.0 (Macintosh/20041206)

Elliotte Harold wrote:
> Ken North wrote:
> 
>> When you store a document in a text column, it's searchable using SQL 
>> queries.
>> Those queries use the indexing capabilities of software such as Oracle
>> interMedia Text Cartridge, DB2 Text Extender and Microsoft Search 
>> service.
> 
> 
> Yes, but suppose I want to find all occurrences of the string "Now is 
> the time for all good men to come to the aid of their country." XML 
> unaware full text search would not normally find "<strong>Now</strong> 
> is the time for all good men to come to the aid of their country."
> 
> More importantly, if I have XML data then I normally want to use the 
> markup to delimit and index the searches. For instance, I might want to 
> find all prescriptions of Xanax with a dosage of 5mg, not all 
> occurrences of the word "Xanax" somewhere near the text "5mg". If we're 
> just storing everything in a CLOB, we might as well be using flat files. 
> The markup has meaning. It should be used to inform and optimize the 
> queries.
> 

You can use Lucene and pass XML documents through a DefaultHandler. For 
example, we have fields for just the text nodes and some of the more 
interesting elements like internal links, external links, glossery 
items, etc... and metadata like who created it, who modified it last, 
created date, last modified, etc... It is rather extensive for us 
because of the way we use XML to configure a site/folder/page/content 
piece. It works very well and is extremely fast.

(I have been thinking you could use Lucene to create a fast, read only 
XML DB. Updating /requires/ you to delete a lucene document, reindex and 
optimize.)

We currently keep everything in the filesystem, but the same concepts 
could be used for XML stored in a DB.

best,
-Rob

• Follow-Ups:
  • more products
    • From: Ronald Bourret <rpbourret@r...>

• References:
  • XML-enabled databases, XQuery APIs
    • From: "Ken North" <kennorth@s...>
  • Re: XML-enabled databases, XQuery APIs
    • From: Elliotte Harold <elharo@m...>

• Prev by Date: Re: [ANN] smallx XML Infoset and Pipeline Released (OpenSource)
• Next by Date: Re: [ANN] smallx XML Infoset and Pipeline Released (OpenSource)
• Previous by thread: Re: XML-enabled databases, XQuery APIs
• Next by thread: more products
• Index(es):
  • Date
  • Thread