[XML-DEV Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message]

RE: Avoiding roundoff errors in calculations?

• To: "'Tim Bray'" <tbray@t...>, "'Roger L. Costello'" <costello@m...>
• Subject: RE: Avoiding roundoff errors in calculations?
• From: "Klotz, Leigh" <Leigh.Klotz@p...>
• Date: Fri, 29 Aug 2003 13:51:59 -0700
• Cc: "'xml-dev@l...'" <xml-dev@l...>

Financial calculations for example.  Plus, IEEE floats just plain give the
wrong answer sometimes.
Try 9/10/10, an from
http://www2.hursley.ibm.com/decimal/decifaq1.html#inexact


-----Original Message-----
From: Tim Bray [mailto:tbray@t...] 
Sent: Friday, August 29, 2003 12:57 PM
To: Roger L. Costello
Cc: xml-dev@l...
Subject: Re:  Avoiding roundoff errors in calculations?


Roger L. Costello wrote:

> What are your thoughts on this?  What techniques do people use to avoid
> introducing roundoff errors?  /Roger

Use FORTRAN, it supports REAL numbers, it says so right in the syntax :)

I'm curious; what applications require more precision than IEEE double? -Tim



-----------------------------------------------------------------
The xml-dev list is sponsored by XML.org <http://www.xml.org>, an
initiative of OASIS <http://www.oasis-open.org>

The list archives are at http://lists.xml.org/archives/xml-dev/

To subscribe or unsubscribe from this list use the subscription
manager: <http://lists.xml.org/ob/adm.pl>

• Prev by Date: Re: Avoiding roundoff errors in calculations?
• Next by Date: Re: Avoiding roundoff errors in calculations?
• Previous by thread: Avoiding roundoff errors in calculations?
• Next by thread: [ANN] xmloperator 2.3
• Index(es):
  • Date
  • Thread