[PD] kml files

marius schebella marius.schebella at gmail.com
Fri Dec 21 01:21:53 CET 2007


Mathieu Bouchard wrote:
>> but what is highest positive integer number I can represent with the 
>> current pd float precision? 16bit? 32.767?
> 
> the highest positive integer is 340282346638528859811704183484516925440 
> but you really want to know which is the highest positive integer for 
> which it is possible to subtract 1. It's 16777216 (I'm saying this 
> number very often on pd-list).

that is true, maybe because this information is missing in the help 
patch. so, when I type this number into a number box, it says 
1.67772e+07 but it still seems to work, because I can subtract 16777216 
correctly.

 >> for now, I am ok with a precision of 1cm.
 >
 > You won't get it with just floats. You will have to use pairs of floats
 > to get to this level.

I separate the longitude values at the comma, which means this number 
(16777216) has to represent a range of ~111 km which gives a precision 
of less than 0.7cm.
marius.




More information about the Pd-list mailing list