[PD] numbers seem to be wrongly adding up

[Roman Haefeli]

On Wed, 2021-05-19 at 13:38 +0200, rolfm at dds.nl wrote:
> 
> the value that should be 0.1250 is actually 0.1249999
> 
> and 0.75 is actually 0.7499994.

The intricacies of 32bit floating point numbers have been discussed up
and down on this list.

tldr; many decimal numbers do not have an exact floating point
representation. Incrementing with such numbers increases the error on
each iteration

Suggestion: Count with integer numbers and scale afterwards.

Roman
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: This is a digitally signed message part
URL: <http://lists.puredata.info/pipermail/pd-list/attachments/20210519/66830673/attachment.sig>