[PD] Some more float weirdness/fun

Mathieu Bouchard matju at artengine.ca
Fri Mar 9 00:03:38 CET 2012


Le 2012-03-08 à 11:47:00, Jonathan Wilkes a écrit :

>> From: Roman Haefeli <reduzent at gmail.com>
>> That's a good example of the implications inherent in floats. What you
>> call a work-around is actually the correct solution. When counting, make
>> sure you count with something that can precisely represented by floats,
>> otherwise the error will grow with each iteration. Integers up to
>> 1.6*10^7 meet that criterion.
> Is this still an issue when float precision is 64-bit?

in float32 you have 24 significant bits.
in float64 you have 53 significant bits.

This means that the limit is pushed back from 16777216 to 9007199254740992 
instead.

  ______________________________________________________________________
| Mathieu BOUCHARD ----- téléphone : +1.514.383.3801 ----- Montréal, QC


More information about the Pd-list mailing list