[PD] working with integers

Christof Ressi info at christofressi.com
Wed May 26 11:05:37 CEST 2021


​The higher the number, the more lower bits will be 0, because the floating point mantissa is too small to store them. It becomes more clear if you use binary notation.

Am 26. Mai 2021, 10:39, um 10:39, rolfm at dds.nl schrieb:
>rolfm at dds.nl schreef op 25-05-2021 23:16:
>
>> hi, 
>> 
>> because of the problems i had with calculations using floating point
>math, 
>> 
>> and following Roman's advice, i changed to integer math. 
>> 
>> however that's easier said then done. 
>> 
>> i'm running again into an unexpected limitation: 
>> 
>> 32-bits can represent signed integers upto 2.147...billion. 
>> 
>> however, as soon as a number is greater then binary 27 bits the last
>byte stays 0.( after 134217727 ) 
>> 
>> e.g. 134200000 + 25000 = 134224992 (should be 134225000). 
>> 
>> what am i missing? 
>> 
>> rolf
>
>correction: the difference is 8, so it's the last 4 bits that are
>involved.
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Pd-list at lists.iem.at mailing list
>UNSUBSCRIBE and account-management ->
>https://lists.puredata.info/listinfo/pd-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.puredata.info/pipermail/pd-list/attachments/20210526/a4416e03/attachment.htm>


More information about the Pd-list mailing list