[XSL-LIST Mailing List Archive Home] [By Thread] [By Date] [Recent Entries] [Reply To This Message] Re: floor() and idiv
2008/11/6 Colin Paul Adams <colin@xxxxxxxxxxxxxxxxxx>: >>>>>> "Andrew" == Andrew Welch <andrew.j.welch@xxxxxxxxx> writes: > > >> You've lost me - we were talking about integer division, I > >> thought. > > Andrew> 1000000000000000000000000000000001 is just too big for an > Andrew> 32 bit integer... (I think that's why DC chose it) > > There is nothing that says you have to use a 32-bit integer. No but I think that's the reason for the Saxon result of 10, 9, 10 (the reason DC chose that number) > >> If you are talking about xs:double, compared with xs:decimal, > >> then yes. But I don't see how that comes into the problem. > > Andrew> I think it's the problem of representing a decimal: > > Andrew> http://speleotrove.com/decimal/decifaq1.html#inexact > > That's talking about representing decimals in floating-point binary - > but you can't do that for xs:decimal -it's not allowed. oh ok, as a CS graduate I should know the different between double, floating point and decimal... that lecture must have been on a Friday afternoon. -- Andrew Welch http://andrewjwelch.com Kernow: http://kernowforsaxon.sf.net/
|
PURCHASE STYLUS STUDIO ONLINE TODAY!Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced! Download The World's Best XML IDE!Accelerate XML development with our award-winning XML IDE - Download a free trial today! Subscribe in XML format
|