[PD] kml files
marius schebella
marius.schebella at gmail.com
Fri Dec 21 01:21:53 CET 2007
Mathieu Bouchard wrote:
>> but what is highest positive integer number I can represent with the
>> current pd float precision? 16bit? 32.767?
>
> the highest positive integer is 340282346638528859811704183484516925440
> but you really want to know which is the highest positive integer for
> which it is possible to subtract 1. It's 16777216 (I'm saying this
> number very often on pd-list).
that is true, maybe because this information is missing in the help
patch. so, when I type this number into a number box, it says
1.67772e+07 but it still seems to work, because I can subtract 16777216
correctly.
>> for now, I am ok with a precision of 1cm.
>
> You won't get it with just floats. You will have to use pairs of floats
> to get to this level.
I separate the longitude values at the comma, which means this number
(16777216) has to represent a range of ~111 km which gives a precision
of less than 0.7cm.
marius.
More information about the Pd-list
mailing list