What is the minimum precision allowed for floats.
Vincent Diepeveen
diep at xs4all.nl
Mon Sep 29 14:36:35 CEST 2008
Sorry for that first comment, i see now i had shipped it directly
also to you.
Ignore comment #1 sorry :)
Vincent
On Sep 29, 2008, at 2:31 PM, Décio Luiz Gazzoni Filho wrote:
>
> On Sep 29, 2008, at 8:59 AM, Vincent Diepeveen wrote:
>
>> Nah not factor 100.
>>
>> After most mathematical calculation you just AND with 0xffffffff
>> to get 48 bits precision.
>>
>
> You'd be right if you were doing integer arithmetic. It's floating
> point, though, so you have more work to do than just arithmetic and
> masking: the overhead of doing sign-magnitude calculations on two's
> complement hardware, lining up the mantissas, adjusting the
> exponent, rounding, etc. If you want to conform to IEEE 754, it's
> even harder.
>
> Perhaps 100x was exaggerated, but I don't think 10x is far off.
>
> Décio
More information about the gmp-discuss
mailing list