<div dir="ltr"><div><div><div>Hi Ronni<br><br></div><div>How do you mean to do it?<br></div><div><br></div>Shannon entropy is not an independent measurement--the information in a observation is relative to the distribution of all it's possible values.<br>
<br></div>If I just take one sample and it's evenly distributed between -0.98 and 1 and it's quantized in 0.02 increments (to make the math easier), then the information of any value observed is:<br></div>-0.01*log(0.01)<br>
<div><div><div><br></div><div>Then--if I had a signal that's N samples long, I have N times as much information. Or perhaps think of it as a rate of information.<br></div><div><br></div><div>But for real numbers and continuous distributions, this doesn't work. The information in a single observation diverges. So, doing that with floating point numbers is not practical.<br>
<br>You often see Shannon entropy describing digital signals. If the signal just switches between 0 and 1, we can generate a distribution of the data and see what the probability is empirically. The entropy of each new sample is relative to the distribution. Likewise, then if you know the maximum rate of switching, you can figure out the maximum rate of information in the signal.<br>
</div><div><br></div><div>Just a few thoughts...<br><br></div><div>Chuck<br></div><div><br></div></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Feb 26, 2013 at 6:09 AM, ronni montoya <span dir="ltr"><<a href="mailto:ronni.montoya@gmail.com" target="_blank">ronni.montoya@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi , i was wondering if anybody have implemented the shannon entropy<br>
function in pd?<br>
<br>
Do anybody have tried measuring entropy of a signal?<br>
<br>
<br>
cheeers<br>
<br>
<br>
<br>
R.<br>
<br>
_______________________________________________<br>
<a href="mailto:Pd-list@iem.at">Pd-list@iem.at</a> mailing list<br>
UNSUBSCRIBE and account-management -> <a href="http://lists.puredata.info/listinfo/pd-list" target="_blank">http://lists.puredata.info/listinfo/pd-list</a><br>
</blockquote></div><br></div>