[GEM-dev] using Android as a tethered screen for vr

[Max]

Thank you so much Antoine and Benjamin for those ideas, I'll try to get 
this running.

I also saw that it's possible to open the Gemwwin on a remote host with 
the [remotehost( message to [gemwin] (see gemwin-help)
However, there is no further explanation of that feature and I haven't 
seen any discussion on pd-list or here about it.
I was wondering if that could work too. With an X Server running on the 
Android.
https://f-droid.org/repository/browse/?fdfilter=x%20server&fdid=au.com.darkside.XServer

Or am I missing something?


On 2017년 04월 04일 09:33, Antoine Villeret wrote:
> Hi,
>
> I was thinking about a solution to stream Gem output to network device
> for a while
> And the solution that came up to my mind is to render in a frame buffer
> and send the texture to a GPU  video encoder like nvenc then download
> the encoded frame to the RAM and stream it.
>
> This would be much more efficient than direct screen grabbing.
>
> Unfortunately I didn't take the time to implement this for now.
> Some vnc server use hardware compression but I don't know one on Linux.
>
> Best
>
> A
>
> Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" <benjah at free.fr
> <mailto:benjah at free.fr>> a écrit :
>
>     Hello,
>
>     Le 03/04/2017 à 18:50, Max a écrit :
>     > On 2017년 04월 02일 20:01, Max wrote:
>     >> Hi Alan,
>     >>
>     >> that's interesting. I haven't thought about the VNC option. I
>     will need
>     >> A VNC server on my Linux computer which allows me to send the
>     content of
>     >> the GEM window only.
>     >
>     > Note to self and anyone searching this some day: this works with
>     x11vnc.
>     > Use the command xwininfo to find out the ID of the window to be
>     > shared, then use
>     > x11vnc -id {id number here}
>     > to share only one window to the vnc client.
>     >
>     > However cardboard-vnc-free is doing too much. First of all, it
>     > controls the moise pointer on the server (as a VNC client should) but
>     > I don't need that. There is an option "Viewer" in the connection
>     > settings that will diable this and lower the latency from about 3
>     > seconds to 1 second.
>     >
>     > cardboard-vnc-free is also adding two viewports to the shared image,
>     > to fake a 3D. That's a show stopper, because I want to use the stereo
>     > mode in GEM.
>     >
>     >> Another idea would be to use VLC on the android phone to open a
>     stream
>     >> that is sent by the computer via Pd/Gem and some way to cast the
>     stream.
>     >
>     > I think this is the way to go. It also has lower latency than a VNC
>     > connection.
>     >
>     > What's the best way to stream a GEM window, so that I can play this
>     > stream with VLC on the Android device?
>     I would say (if you are on linux) : use
>     https://github.com/umlaeute/v4l2loopback
>     <https://github.com/umlaeute/v4l2loopback> to create a virtual v4l2
>     device, then it's possible to use pix_record eventually in conjonction
>     with pix_snap to shoot Gem window and write it to this virtual v4l2
>     device (on my computer, it would involve to send a [codec v4l2< message
>     to pix_record)
>     then you can stream to the Android device with ffmpeg fed by this v4l2
>     device and read it with vlc
>
>     also possible to grab the Gem screen with ffmpeg -f x11grab +options
>
>     ++
>     b
>     >
>     >
>     > M.
>     >
>     >
>     >
>     >> On 2017년 04월 01일 23:31, Alan Brooker wrote:
>     >>> Hey Max,
>     >>>
>     >>> Recently I have been looking at this very subject, in the end using
>     >>> trinus vr (trinusvirtualreality.com
>     <http://trinusvirtualreality.com> <http://trinusvirtualreality.com
>     <http://trinusvirtualreality.com>>)
>     >>>  on windows was the easiest solution for me
>     >>>
>     >>>  I have tried something similar on linux (Fedora) but my problem was
>     >>> just getting my PC to actually connect with my phone- this would be
>     >>> trivial I assume for someone who is experienced setting up VNC
>     >>> connections/networking on Linux. So take a look at these and
>     good luck
>     >>>
>     >>>
>     https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardremotedesktop.lite&hl=en
>     <https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardremotedesktop.lite&hl=en>
>     >>>
>     >>>
>     >>> http://www.vrbites.com/apps/cardboard-vnc-free/
>     <http://www.vrbites.com/apps/cardboard-vnc-free/>
>     >>>
>     >>> On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements at revolwear.com
>     <mailto:abonnements at revolwear.com>
>     >>> <mailto:abonnements at revolwear.com
>     <mailto:abonnements at revolwear.com>>> wrote:
>     >>>
>     >>>     Hi list,
>     >>>
>     >>>     I'm looking for a solution to use the gem output on an android
>     >>> phone
>     >>>     for vr.
>     >>>
>     >>>     I found this app, but it is windows only, no linux host.
>     >>>     http://www.swatterco.com/vr_streamer.php
>     <http://www.swatterco.com/vr_streamer.php>
>     >>>     <http://www.swatterco.com/vr_streamer.php
>     <http://www.swatterco.com/vr_streamer.php>>
>     >>>
>     >>>     Any ideas about this?
>     >>>
>     >>>     m.