Re: Comparing numbers with different precisions

Play the video

Subject: Re: Comparing numbers with different precisions
From: Michael Kay <mike@xxxxxxxxxxxx>
Date: Thu, 09 Feb 2012 10:50:56 +0000

On 09/02/2012 10:22, David Carlisle wrote:

On 09/02/2012 09:54, Clint Redwood wrote:
> I also note that the xpath function "round" doesn't have any
> precision associated with it, so I can't just count the decimal
> places of the shorter value and round the longer to that precision.
yes not sure why they didn't add a precision argument. round-to-half-even does have a precision argument so you could use that if that rounding is acceptable, or if you want to use round you can of course scale by a suitable power of 10 to bring the precisions into play.

A second argument to round() has been added in XPath 3.0.

Mind you, since it's in terms of decimal places, it can cause confusion when used with double or float data types - I would recommend only using it with xs:decimal.

Michael Kay
Saxonica

Current Thread
Comparing numbers with different precisions, (continued) Clint Redwood - 9 Feb 2012 09:25:18 -0000 David Carlisle - 9 Feb 2012 09:41:04 -0000 Clint Redwood - 9 Feb 2012 09:54:54 -0000 David Carlisle - 9 Feb 2012 10:23:00 -0000 Michael Kay - 9 Feb 2012 10:51:06 -0000 <=

<- Previous	Index	Next ->
Re: Comparing numbers with di, David Carlisle	Thread	XSLT 2 processors, Terence Kearns
Re: Comparing numbers with di, David Carlisle	Date	XSLT 2 processors, Terence Kearns
	Month

PURCHASE STYLUS STUDIO ONLINE TODAY!

Purchasing Stylus Studio from our online shop is Easy, Secure and Value Priced!

Download The World's Best XML IDE!

Accelerate XML development with our award-winning XML IDE - Download a free trial today!

Subscribe in XML format

RSS 2.0
Atom 0.3

XML Editor - Download a 15 Day Free Trial Now >

See What's New in Stylus Studio >

Buy Stylus Studio - XML Editor - Now >