[PD] more about float limitation

Cyrille Henry ch at chnry.net
Thu Jan 29 19:04:05 CET 2015



Le 29/01/2015 18:36, Alexandre Torres Porres a écrit :
>  > more that 7 digit but less than 8 digits
> ...
>> so, 4/3 =! 1.33333
>> but 4/3 == 1.33333333 (8 "3")
>
> I don't get it. More than 7 decimal digits but less than 8 decimal digits?
yes
about 7.22 as Claude pointed : log(2^24-1)
2^24-1 is the max value coded in 23bit,
log(x) compute the number of digit of a number.
unfortunately, the result is not an integer.


>How does that work? In practice, is it 7 or 8?
in practice, number are rounded to the closest value that can be represented in this format.

forget about the comma :
the max number that can be represented without exponent is 2^24-1 (max value of 23bits)
i.e 16777215
in this case, 8 correct digits
if you add 1, it should be 16777216, but that need 24 bit, and it's not possible in a float.
so it's noted 1677722 * 10^1
...

>
> In the example we see that 4/3 == 1.33333333 (8 "3") - so it's 8 decimal digits...

better to say a 9 digit number.

>
> I have a work around using expr. Just put the number in parenthesis.
>
> Try [expr 4./3 == (1.33333333)] (8 "3")
>
> but the thing is that this is also true - [expr 4./3 == (1.3333333)] - also equal to 7 "3"
7 "3", mean 8 digits number: max precision of a float-> no surprise.

cheers
c

>
> cheers
>
> 2015-01-29 14:58 GMT-02:00 Cyrille Henry <ch at chnry.net <mailto:ch at chnry.net>>:
>
>     hello,
>
>     ok, claude was faster to answer, but since i already write my mail, i send it anyway...
>
>
>     pd internal resolution is float32.
>     (i.e, 23 bit, so a bit less than 17 millions, i.e more that 7 digit but less than 8 digits)
>     pd graphical representation is 6 digits
>
>     so, 4/3 =! 1.33333 but 4/3 == 1.33333333 (8 "3")
>     even if both are represented with the same number of 3...
>     this is a generic problem of computer float.
>
>     the only odd thing concerning pd is that number are also saved with 6 digit.
>     (so precision can be lost when a patch is saved)
>
>     try the attachment patch.
>     then save the patch, and open it back, and see that precision is lost.
>     (I have to modifies the patch as text file to have this behaviors, but you can also have the save precision when creating an object... until you save/load the patch)
>
>     you can also have a look on the top right of the patch: a weird effect of float precision...
>
>     cheers
>     c
>
>     Le 29/01/2015 17:17, Alexandre Torres Porres a écrit :
>
>         Well, thanks everyone.
>
>         And now for some related issues.
>
>         Pd can only represent up to 6 significant digits, so they say. For example, in a message, you can have a number with up to 5 decimal places, like: -5.29314e+12
>
>         but it does have a better internal resolution, if you compare 4 / 3 to 1.33333 you'll see 4 / 3 is higher ( try [expr 4./3 > 1.33333] and check).
>
>         So, what's this internal resolution? And why can't you have the same resolution in a message?
>
>         thanks
>
>         2015-01-28 16:06 GMT-02:00 Martin Peach <chakekatzil at gmail.com <mailto:chakekatzil at gmail.com> <mailto:chakekatzil at gmail.com <mailto:chakekatzil at gmail.com>>__>:
>
>              On Wed, Jan 28, 2015 at 12:00 PM, Cyrille Henry <ch at chnry.net <mailto:ch at chnry.net> <mailto:ch at chnry.net <mailto:ch at chnry.net>>> wrote:
>
>
>
>                  Le 28/01/2015 17:47, Alexandre Torres Porres a écrit :
>
>                        > it's a limitation of 32 bit float
>
>                      I thought so, but same happens when I use the new Pd Vanilla 64 bits...
>
>                  this mean that it's compiled for 64 bit CPU, not that float are store on 64 bits
>
>              Also last time I checked, Pd saves floats by first printing them to 6 digit precision, so they have even less range than a 'float' type.
>              You could use an object made with pdlua to manipulate large floating-point numbers, as there is no(?) limit to the size of a float in lua.
>
>              Martin
>
>              _________________________________________________
>         Pd-list at lists.iem.at <mailto:Pd-list at lists.iem.at> <mailto:Pd-list at lists.iem.at <mailto:Pd-list at lists.iem.at>> mailing list
>              UNSUBSCRIBE and account-management -> http://lists.puredata.info/__listinfo/pd-list <http://lists.puredata.info/listinfo/pd-list>
>
>
>



More information about the Pd-list mailing list