[GEM-dev] using Android as a tethered screen for vr

[Antoine Villeret]

Hi,

I was thinking about a solution to stream Gem output to network device for
a while
And the solution that came up to my mind is to render in a frame buffer and
send the texture to a GPU  video encoder like nvenc then download the
encoded frame to the RAM and stream it.

This would be much more efficient than direct screen grabbing.

Unfortunately I didn't take the time to implement this for now.
Some vnc server use hardware compression but I don't know one on Linux.

Best

A

Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" <benjah at free.fr> a écrit :

> Hello,
>
> Le 03/04/2017 à 18:50, Max a écrit :
> > On 2017년 04월 02일 20:01, Max wrote:
> >> Hi Alan,
> >>
> >> that's interesting. I haven't thought about the VNC option. I will need
> >> A VNC server on my Linux computer which allows me to send the content of
> >> the GEM window only.
> >
> > Note to self and anyone searching this some day: this works with x11vnc.
> > Use the command xwininfo to find out the ID of the window to be
> > shared, then use
> > x11vnc -id {id number here}
> > to share only one window to the vnc client.
> >
> > However cardboard-vnc-free is doing too much. First of all, it
> > controls the moise pointer on the server (as a VNC client should) but
> > I don't need that. There is an option "Viewer" in the connection
> > settings that will diable this and lower the latency from about 3
> > seconds to 1 second.
> >
> > cardboard-vnc-free is also adding two viewports to the shared image,
> > to fake a 3D. That's a show stopper, because I want to use the stereo
> > mode in GEM.
> >
> >> Another idea would be to use VLC on the android phone to open a stream
> >> that is sent by the computer via Pd/Gem and some way to cast the stream.
> >
> > I think this is the way to go. It also has lower latency than a VNC
> > connection.
> >
> > What's the best way to stream a GEM window, so that I can play this
> > stream with VLC on the Android device?
> I would say (if you are on linux) : use
> https://github.com/umlaeute/v4l2loopback to create a virtual v4l2
> device, then it's possible to use pix_record eventually in conjonction
> with pix_snap to shoot Gem window and write it to this virtual v4l2
> device (on my computer, it would involve to send a [codec v4l2< message
> to pix_record)
> then you can stream to the Android device with ffmpeg fed by this v4l2
> device and read it with vlc
>
> also possible to grab the Gem screen with ffmpeg -f x11grab +options
>
> ++
> b
> >
> >
> > M.
> >
> >
> >
> >> On 2017년 04월 01일 23:31, Alan Brooker wrote:
> >>> Hey Max,
> >>>
> >>> Recently I have been looking at this very subject, in the end using
> >>> trinus vr (trinusvirtualreality.com <http://trinusvirtualreality.com>)
> >>>  on windows was the easiest solution for me
> >>>
> >>>  I have tried something similar on linux (Fedora) but my problem was
> >>> just getting my PC to actually connect with my phone- this would be
> >>> trivial I assume for someone who is experienced setting up VNC
> >>> connections/networking on Linux. So take a look at these and good luck
> >>>
> >>> https://play.google.com/store/apps/details?id=tantra.tantransha.
> cardboardremotedesktop.lite&hl=en
> >>>
> >>>
> >>> http://www.vrbites.com/apps/cardboard-vnc-free/
> >>>
> >>> On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements at revolwear.com
> >>> <mailto:abonnements at revolwear.com>> wrote:
> >>>
> >>>     Hi list,
> >>>
> >>>     I'm looking for a solution to use the gem output on an android
> >>> phone
> >>>     for vr.
> >>>
> >>>     I found this app, but it is windows only, no linux host.
> >>>     http://www.swatterco.com/vr_streamer.php
> >>>     <http://www.swatterco.com/vr_streamer.php>
> >>>
> >>>     Any ideas about this?
> >>>
> >>>     m.
> >
> > _______________________________________________
> > GEM-dev mailing list
> > GEM-dev at lists.iem.at
> > https://lists.puredata.info/listinfo/gem-dev
>
>
> _______________________________________________
> GEM-dev mailing list
> GEM-dev at lists.iem.at
> https://lists.puredata.info/listinfo/gem-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.puredata.info/pipermail/gem-dev/attachments/20170404/a57402cc/attachment.html>