What is the minimum precision allowed for floats.

Vincent Diepeveen diep at xs4all.nl
Mon Sep 29 14:36:35 CEST 2008

Sorry for that first comment, i see now i had shipped it directly  
also to you.
Ignore comment #1 sorry :)


On Sep 29, 2008, at 2:31 PM, Décio Luiz Gazzoni Filho wrote:

> On Sep 29, 2008, at 8:59 AM, Vincent Diepeveen wrote:
>> Nah not factor 100.
>> After most mathematical calculation you just AND with 0xffffffff
>> to get 48 bits precision.
> You'd be right if you were doing integer arithmetic. It's floating  
> point, though, so you have more work to do than just arithmetic and  
> masking: the overhead of doing sign-magnitude calculations on two's  
> complement hardware, lining up the mantissas, adjusting the  
> exponent, rounding, etc. If you want to conform to IEEE 754, it's  
> even harder.
> Perhaps 100x was exaggerated, but I don't think 10x is far off.
> Décio

More information about the gmp-discuss mailing list