[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

single precision bug

Subject: single precision bug
From: "ronald" <ronald@xxxxxxxxxxx>
Date: Tue, 17 Aug 2004 14:37:24 +0200
single precision
Hi there,

I have run into something people here call the "single precision bug"

A rather large XML file containing all kinds of financ. information is being
validated using schematron.

the test I do is as follows:

totalDebit = sum(.//debitAmount)"

meaning: there is an element named totalDebit that should have the same
value as the sum of all debitamount elements in the file.

I happen to know this is the case, the test however fails.

A better inspection learns me that the XSLT processor makes a mistake here
totalDebit - sum(./debitAmount) gives me a value of:

-0.00000000005820766091346741 whereas this should be 0.

MsXML, Saxon,Xalan, XT all have this error only Sablotron returns the
correct value.

What do you all think of this?

Cheers

Ronald





---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.735 / Virus Database: 489 - Release Date: 6-8-2004
 

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.735 / Virus Database: 489 - Release Date: 6-8-2004

Current Thread

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Buy Stylus Studio Now

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Don't miss another message! Subscribe to this list today.
Email
First Name
Last Name
Company
Subscribe in XML format
RSS 2.0
Atom 0.3
Site Map | Privacy Policy | Terms of Use | Trademarks
Free Stylus Studio XML Training:
W3C Member
Stylus Studio® and DataDirect XQuery ™are products from DataDirect Technologies, is a registered trademark of Progress Software Corporation, in the U.S. and other countries. © 2004-2013 All Rights Reserved.