Re: bug in float on Pentium

From: Jakob Østergaard (jakob@unthought.net)
Date: Fri Apr 13 2001 - 23:01:01 EDT

  • Next message: Eric S. Raymond: "CML 1.1.0, aka "I feel the need...the need for speed.""

    On Fri, Apr 13, 2001 at 07:23:24PM -0400, Joe wrote:
    > Not sure but I think I found a NEW bug.
    >
    > I know that there have been some issues with pentiums and floating point
    > arrithmatic, but this takes the cake...
    >
    > Linux Lserver.org 2.2.18 #43 SMP Fri Mar 9 14:19:41 EST 2001 i586
    > unknown
    >
    ...
    >
    >
    > I am getting the following as output
    >
    > joeja@Lserver$ ./testf
    > 5483.990000
    > 5483.990234
    >
    >
    > what is with the .990234?? it should be .990000
    >
    > any ideas on this??
    >

    Your second number is a 32-bit float - which has roughly 7 digits of
    precision. Just like your program output clearly shows.

    (I do however fail to see the relevance of this to linux-kernel) 

    -- 
................................................................
:   jakob@unthought.net   : And I see the elder races,         :
:.........................: putrid forms of man                :
:   Jakob Østergaard      : See him rise and claim the earth,  :
:        OZ9ABN           : his downfall is at hand.           :
:.........................:............{Konkhra}...............:
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

    This archive was generated by hypermail 2b29 : Fri Apr 13 2001 - 23:04:02 EDT