[PD] streaming audio and video in Linux

Wed Mar 4 15:54:32 CET 2009

so i did get this working on linux with mencoder + pdp_rawin using code:

#! /bin/sh
rm /tmp/pipe
mknod /tmp/pipe p
mencoder -nosound -ovc raw -of rawvideo -vf scale,format=rgb24 mms://ph.wm.live05.pscdn.net/00302597_live12?MSWMExt=.asf -o /tmp/pipe

although i am finding this might be inefficient having to convert colorspace from  yuv -> rgb -> yuv....the only way i have been able to get this to work is to do this. i am not sure why, admitting i am limited in my understanding of colorspace.

>From mencoder i get something like:

Decoder is capable of YUV output (flags 0x1b)
VDec: vo config request - 320 x 240 (preferred colorspace: Packed YUY2)
VDec: using Planar YV12 as output csp (no 0)
Movie-Aspect is undefined - no prescaling applied.
[swscaler @ 0x883e3d0]No accelerated colorspace conversion found
[swscaler @ 0x883e3d0]SwScaler: using unscaled yuv420p -> rgb24 special converter

then with pdp_rawin i have to send messages:

[tmp/pipe(
[bitmap/rgb/320x240(

then i have to convert back to yuv using:

[pdp_convert image/YCrCb/*]

....and thats the only way i can get it to work.

i have tried something like:

[pdp_rawin tmp/pipe bitmap/yuv (or even yv12)/320x240]

with accompanying altered mencoder script with nothing but a static, f'ed up image.

i am not complaining too much because i am pretty happy this is just working in general... i am just looking to make it a little more efficient and i am a little confused over all the yuv/yv12 stuff that is going on and why i have to convert to rgb and back to yuv just to get it to work right - with the understanding pdp/yuv is the fastest and most efficient.

BTW the piping stuff is really killer! although i have only been able to get it to work on linux... osx gives me a wicked big file that continuously increases in size as the stream is converted. linux just makes a 0k tmp/pipe that is very nice. i guess this is just a mencoder thing on osx obviously.

thanks!
m

--- On Sun, 3/1/09, Jaime Oliver <jaime.oliver2 at gmail.com> wrote:

> From: Jaime Oliver <jaime.oliver2 at gmail.com>
> Subject: Re: [PD] streaming audio and video in Linux
> To: mgrimm at syr.edu
> Cc: "ydegoyon at gmail.com" <ydegoyon at gmail.com>, "pd-list" <pd-list at iem.at>, "John Harrison" <johnharrisonwsu at gmail.com>
> Date: Sunday, March 1, 2009, 12:50 PM
> Well, I haven't done it myself, I just know you
> can...there is a mencoder
> list: "MEncoder usage discussions"
> <mencoder-users at mplayerhq.hu>,
> and documentation somewhere.
> 
> best,
> 
> Jaime
> 
> On Sun, Mar 1, 2009 at 8:17 AM, mark edward grimm
> <mgrimm at syr.edu> wrote:
> 
> >
> > yeah i will take a look at this...
> >
> > might you have an example shell script + pd patch for
> piping stream from
> > mencoder to pdp_rawin?
> >
> > i saw this thread but i am not sure if issue ever were
> resolved:
> >
> >
> http://lists.puredata.info/pipermail/pd-list/2008-04/061727.html
> >
> >
> > thanks!
> > m
> >
> >
> >
> > --- On Sat, 2/28/09, Jaime Oliver
> <jaime.oliver2 at gmail.com> wrote:
> >
> > > From: Jaime Oliver
> <jaime.oliver2 at gmail.com>
> > > Subject: Re: [PD] streaming audio and video in
> Linux
> > > To: mgrimm at syr.edu
> > > Cc: "ydegoyon at gmail.com"
> <ydegoyon at gmail.com>, "pd-list"
> <pd-list at iem.at>,
> > "John Harrison"
> <johnharrisonwsu at gmail.com>
> > > Date: Saturday, February 28, 2009, 2:24 AM
> > > MEncoder maybe?
> > >
> > > On Fri, Feb 27, 2009 at 7:50 AM, mark edward
> grimm
> > > <mgrimm at syr.edu> wrote:
> > >
> > > >
> > > > > no, pdp_icedthe~ can receive a stream
> > > >
> > > > ah thats right thanks!
> > > >
> > > > > we will not try to support an
> .asx/proprietary
> > > format,
> > > >
> > > > understandable.... yeah i want to
> "hijack"
> > > someone else's stream - it just
> > > > happens to be in .asx!!!
> > > >
> > > > i wonder if there is a method for real-time
> > > transcoding....? from asx to
> > > > ogg?
> > > >
> > > > ____________________
> > > > mark edward grimm | m.f.a | ed.m
> > > > syracuse u. | vpa foundations | timearts
> > > > adjunct | new media consultant
> > > > megrimm.net | socialmedia.org/GROUP &
> LLC
> > > > mgrimm at syr.edu | 315.378.2136
> > > > ________________________________________
> > > >
> > > >
> > > >
> > > >
> > > > --- On Fri, 2/27/09, ydegoyon at gmail.com
> > > <ydegoyon at gmail.com> wrote:
> > > >
> > > > > From: ydegoyon at gmail.com
> > > <ydegoyon at gmail.com>
> > > > > Subject: Re: [PD] streaming audio and
> video in
> > > Linux
> > > > > To: mgrimm at syr.edu
> > > > > Cc: "pd-list"
> <pd-list at iem.at>,
> > > "John Harrison" <
> > > > johnharrisonwsu at gmail.com>
> > > > > Date: Friday, February 27, 2009, 10:39
> AM
> > > > > mark edward grimm wrote:
> > > > > > hmmm... yeah sorry for changing
> the subject
> > > on this.
> > > > > >
> > > > > > I was actually wondering the
> opposite of the
> > > original
> > > > > poster, how to get a stream
> 'into' pd....
> > > > > >
> > > > > > For example i have access to a
> stream
> > > > >
> (http://someone-elses-website/live12.asx) that is
> > > not my
> > > > > own....
> > > > > >
> > > > > > This stream I can open in VLC
> player for
> > > example....
> > > > > >
> > > > > > How can I utilize this stream in
> pd?
> > > directly or
> > > > > indirectly (through vlc player?).....
> to do
> > > motion tracking
> > > > > on the stream for example.
> > > > > >
> > > > > > the pdp_theora stuff is just for
> streaming
> > > out FROM pd
> > > > > correct?
> > > > > >
> > > > > >
> > > > > no, pdp_icedthe~ can receive a stream
> > > > > but only in ogg/theora format,
> > > > > we will not try to support an
> .asx/proprietary
> > > format,
> > > > > well not me.
> > > > >
> > > > > sevy
> > > > > > m
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> _______________________________________________
> > > > Pd-list at iem.at mailing list
> > > > UNSUBSCRIBE and account-management ->
> > > > http://lists.puredata.info/listinfo/pd-list
> > > >
> > >
> > >
> > >
> > > --
> > > Jaime E Oliver LR
> > >
> > > joliverl at ucsd.edu
> > > www.realidadvisual.org/jaimeoliver
> > > www-crca.ucsd.edu/
> > > www.realidadvisual.org
> > >
> > > 858 202 1522
> > > 9168 Regents Rd. Apt. G
> > > La Jolla, CA 92037
> > > USA
> >
> 
> 
> 
> -- 
> Jaime E Oliver LR
> 
> joliverl at ucsd.edu
> www.realidadvisual.org/jaimeoliver
> www-crca.ucsd.edu/
> www.realidadvisual.org
> 
> 858 202 1522
> 9168 Regents Rd. Apt. G
> La Jolla, CA 92037
> USA