[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

Re: indexing and querying XML (not XQuery)

• To: Wolfgang Hoschek <whoschek@l...>
• Subject: Re: indexing and querying XML (not XQuery)
• From: Robert Koberg <rob@k...>
• Date: Tue, 23 Aug 2005 15:41:27 -0400
• Cc: XML Developers List <xml-dev@l...>
• In-reply-to: <DBEE72B5-8BB9-4855-81D6-17F7C3AFC311@l...>
• References: <430B1F36.5030607@k...> <DBEE72B5-8BB9-4855-81D6-17F7C3AFC311@l...>
• User-agent: Mozilla Thunderbird 1.0 (Macintosh/20041206)

Wolfgang Hoschek wrote:
> A starting point may be MemoryIndex (http://dsd.lbl.gov/nux/api/ 
> index.html), which can be used for Lucene fulltext search over  
> comparatively small *transient main memory* XML documents, for  example 
> as in Nux XQuery. Note, however, that it is not  straightforward to 
> extend XML fulltext quering over transient main  memory to XML fulltext 
> quering over huge persistent XML document  collections; the underlying 
> technology is bound to be vastly  different wrt. data management, 
> indexing and transactional  properties, though the high level search API 
> may indeed remain  indentical or similar.

Cool. (I saw some of your posts on the lucene list).

Does this require Saxon 8x?

I have done some RAMDirectory searches, but for things like forum posts 
that need to deny postings that contain 'bad' words (for a young girls 
portal). But I need to search large collections of XML config and content.

The worst thing about this is updating the index, but it is not a 
showstopper.

Can you expand more on:

"the underlying
 > technology is bound to be vastly  different wrt. data management,
 > indexing and transactional  properties"

it would seem similar to me. That is, if the instance XML changes you 
have to open the reader, delete the Lucene document, reindex the new 
document, add it, optimize and close the reader.

best,
-Rob

> 
> Wolfgang.

• Follow-Ups:
  • Re: indexing and querying XML (not XQuery)
    • From: Wolfgang Hoschek <whoschek@l...>

• References:
  • indexing and querying XML (not XQuery)
    • From: Robert Koberg <rob@k...>
  • Re: indexing and querying XML (not XQuery)
    • From: Wolfgang Hoschek <whoschek@l...>

• Prev by Date: RE: indexing and querying XML (not XQuery)
• Next by Date: Re: indexing and querying XML (not XQuery)
• Previous by thread: Re: indexing and querying XML (not XQuery)
• Next by thread: Re: indexing and querying XML (not XQuery)
• Index(es):
  • Date
  • Thread