Re: bug in float on Pentium

From: Jakob Østergaard (jakob@unthought.net)
Date: Fri Apr 13 2001 - 22:01:01 EST


On Fri, Apr 13, 2001 at 07:23:24PM -0400, Joe wrote:
> Not sure but I think I found a NEW bug.
>
> I know that there have been some issues with pentiums and floating point
> arrithmatic, but this takes the cake...
>
> Linux Lserver.org 2.2.18 #43 SMP Fri Mar 9 14:19:41 EST 2001 i586
> unknown
>
...
>
>
> I am getting the following as output
>
> joeja@Lserver$ ./testf
> 5483.990000
> 5483.990234
>
>
> what is with the .990234?? it should be .990000
>
> any ideas on this??
>

Your second number is a 32-bit float - which has roughly 7 digits of
precision. Just like your program output clearly shows.

(I do however fail to see the relevance of this to linux-kernel)

-- 
................................................................
:   jakob@unthought.net   : And I see the elder races,         :
:.........................: putrid forms of man                :
:   Jakob Østergaard      : See him rise and claim the earth,  :
:        OZ9ABN           : his downfall is at hand.           :
:.........................:............{Konkhra}...............:
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/



This archive was generated by hypermail 2b29 : Sun Apr 15 2001 - 21:00:22 EST