[PD] PD Float accuracy

errordeveloper at gmail.com errordeveloper at gmail.com
Fri Nov 7 09:13:05 CET 2008


On Thu, Nov 06, 2008 at 10:50:51PM +0000, Mark Sexton wrote:
> Hi
> I need PD to make simple but accurate calculations for a sonification project. However there seems to be a problem working accurately with floats that have 7 or more digits in total (before or after the decimal point). PD always seem to round the figure to 6 digits whether in a calculation, or even typing a 7+ digit float into a number box e.g. 1234.5678 rounded to 1234.57
have you the size of numbox set to '0' ?
> 
> I've got a couple of ugly hacks to work around for now, but it seems a fairly fundamental thing to do, so would be grateful to hear if I'm missing a simple way to get PD to work accurately with floats of any arbitrary length above 6 digits.
> 
i think there is octave object, try and see if that could give any
different results, but i doubt it would ;)
> Cheers
> 
> 
> Mark
> 
> 
> 
> 
> _______________________________________________
> Pd-list at iem.at mailing list
> UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list




More information about the Pd-list mailing list