Thanks for the replies.<br><br>problems solved by using 2 Pd instances, one for video, the other for audio, communicating via OSC on the same machine (or even different machines). The machine also had to have a better CPU as doing this on a slower dualcore laptop only fixed the audio, while the video got very slow. <br>
<br>best,<br><br>On Monday, November 14, 2011, Hans-Christoph Steiner <<a href="mailto:hans@at.or.at">hans@at.or.at</a>> wrote:<br>><br>> I think generally, for gem + audio patches, people run two instances of Pd, one for Gem and the other for the audio. The audio instance has realtime priority, and the Gem one does not.<br>
><br>> .hc<br>><br>> On Nov 13, 2011, at 10:17 PM, Ricardo Fabbri wrote:<br>><br>>> Hi,<br>>><br>>> I am building instalations/instruments which control sounds<br>>> through the webcam, using a color detector that I submitted to this<br>
>> list a couple of days ago. Things work well, and I am just facing real<br>>> time/delay issues now.<br>>> When I try to generate sound with any pix<br>>> processing, I am getting jumps in the sound (like on/off sounds at<br>
>> about 5-20Hz). Turning off any pix processing, the sound is then back<br>>> to normal, even if I show the raw video from the camera on a gemwin.<br>>> By pix processing I mean anything with even only 1 pass through the<br>
>> image on the CPU. I am using a ps3eye camera, which makes things<br>>> better as it has a high framerate, but I still get interruptions in<br>>> the sound.<br>>><br>>> Why is this lag in the sound? The image with the output of the pix<br>
>> processing doesn't seem to be moving any slower with or without sound.<br>>><br>>> What are your experiences in trying to get gem pix processing, video,<br>>> and DSP to work in real time? My application is interactive, so that I<br>
>> really need the sound to be as smooth as possible. Here are some<br>>> factors I will investigate, let me know if they make any sense to you:<br>>><br>>> - It could be just too much data, even a single pass on each pixel<br>
>> could be causing delays/jumps. I could downsample the image prior to<br>>> any pix processing<br>>> - The kernel is too slow in processing the video stream; I tried '-rt'<br>>> with no success<br>
>> - Perhaps there is a problem in Pd sound scheduling vs pix processing<br>>> - Perhaps its just the CPU. In fact, I used OSC to do the video on one<br>>> machine, send the parameters to a second machine which then processes<br>
>> the audio there. This effectively solved the problem. Question is, is<br>>> this due to CPU or to another factor?<br>>><br>>> I would really appreciate hearing ideas from you, as I am new to this.<br>
>> Best,<br>>> Ricardo Fabbri<br>>> --<br>>> Linux registered user #175401<br>>> <a href="http://www.lems.brown.edu/~rfabbri">www.lems.brown.edu/~rfabbri</a><br>>> <a href="http://labmacambira.sf.net">labmacambira.sf.net</a><br>
>><br>>> _______________________________________________<br>>> GEM-dev mailing list<br>>> <a href="mailto:GEM-dev@iem.at">GEM-dev@iem.at</a><br>>> <a href="http://lists.puredata.info/listinfo/gem-dev">http://lists.puredata.info/listinfo/gem-dev</a><br>
><br>><br>><br>> ----------------------------------------------------------------------------<br>><br>> Computer science is no more related to the computer than astronomy is related to the telescope. -Edsger Dykstra<br>
><br>><br>><br><br>-- <br><br>Ricardo Fabbri<br>--<br>Linux registered user #175401<br><a href="http://www.lems.brown.edu/~rfabbri" target="_blank">www.lems.brown.edu/~rfabbri</a><br><a href="http://labmacambira.sf.net" target="_blank">labmacambira.sf.net</a><br>
<br>