Count of Distinct elements performance problem

[Kusunam, Srinivas]

Sorry I forgot to mention the environment.

 

XQuery Engine:   Data Direct

OS:                  Linux 32 bit

JVM:                  1.5.0

 

Are there any other products in the market which can handle this load? 

 

I tried with Saxon and it goes out of memory for even 1GB file on 32 bit
machine (1.8GB memory limitation) which does make sense as you said
previously Saxon needs a memory at least 3 times the size of input XML.

 

Thanks,

Srinivas

 

________________________________

From: Michael Kay [mailto:http://xquery.com/mailman/listinfo/talk] 
Sent: Wednesday, August 23, 2006 3:55 PM
To: Kusunam, Srinivas; http://xquery.com/mailman/listinfo/talk
Subject: RE:  Count of Distinct elements performance
problem

 

Did you tell us what product you are using?

 

As I mentioned, the recursive code depends heavily on optimization in
the processor - as indeed does everything, with the kind of data volumes
you are dealing with.

 

Michael Kay

http://www.saxonica.com/


*****************************************************************
This message has originated from RLPTechnologies,
26955 Northwestern Highway, Southfield, MI 48033.

RLPTechnologies sends various types of email
communications.  If this email message concerns the
potential licensing of an RLPT product or service, and
you do not wish to receive further emails regarding Polk
products, forward this email to http://xquery.com/mailman/listinfo/talk
with the word "remove" in the subject line.

The email and any files transmitted with it are confidential
and intended solely for the individual or entity to whom they
are addressed.

If you have received this email in error, please delete this
message and notify the Polk System Administrator at
http://xquery.com/mailman/listinfo/talk
*****************************************************************

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://x-query.com/pipermail/talk/attachments/20060823/c7bb7711/attachment.htm