[GEM-dev] using Android as a tethered screen for vr
Antoine Villeret
antoine.villeret at gmail.com
Tue Apr 4 10:34:35 CEST 2017
concerning the remotehost message I think you are referring to [create
remotehost:id( message right ?
this message let you choose the X display where to open the rendering
window.
I'm using it when controlling patch over SSH, the patch GUI is displayed on
my laptop somewhere in the world, while the rendering window is displayed
on the local computer on which Pd is running.
I have to create the window with [create locahost:0( because on an SSH
session with window forwarding (ssh -x or ssh -y) $DISPLAY env variable is
defined to :10.
I don't know how to do the reverse (display patcher GUI on local computer
and rendering window on remote one, in your case an android device)
I'm also using VirtualGL to display OpenGL accelerated window on a remote
device for example to display rendering window on my laptop over SSH.
VIrtual GL is much more efficient than any VNC application I ever used (but
I didn't try them all).
Unfortunately VirtualGL doesn't seem to work on Android.
Best
Antoine
--
do it yourself
http://antoine.villeret.free.fr
2017-04-04 10:14 GMT+02:00 Max <abonnements at revolwear.com>:
> Thank you so much Antoine and Benjamin for those ideas, I'll try to get
> this running.
>
> I also saw that it's possible to open the Gemwwin on a remote host with
> the [remotehost( message to [gemwin] (see gemwin-help)
> However, there is no further explanation of that feature and I haven't
> seen any discussion on pd-list or here about it.
> I was wondering if that could work too. With an X Server running on the
> Android.
> https://f-droid.org/repository/browse/?fdfilter=x%20server&
> fdid=au.com.darkside.XServer
>
> Or am I missing something?
>
>
> On 2017년 04월 04일 09:33, Antoine Villeret wrote:
>
>> Hi,
>>
>> I was thinking about a solution to stream Gem output to network device
>> for a while
>> And the solution that came up to my mind is to render in a frame buffer
>> and send the texture to a GPU video encoder like nvenc then download
>> the encoded frame to the RAM and stream it.
>>
>> This would be much more efficient than direct screen grabbing.
>>
>> Unfortunately I didn't take the time to implement this for now.
>> Some vnc server use hardware compression but I don't know one on Linux.
>>
>> Best
>>
>> A
>>
>> Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" <benjah at free.fr
>> <mailto:benjah at free.fr>> a écrit :
>>
>>
>> Hello,
>>
>> Le 03/04/2017 à 18:50, Max a écrit :
>> > On 2017년 04월 02일 20:01, Max wrote:
>> >> Hi Alan,
>> >>
>> >> that's interesting. I haven't thought about the VNC option. I
>> will need
>> >> A VNC server on my Linux computer which allows me to send the
>> content of
>> >> the GEM window only.
>> >
>> > Note to self and anyone searching this some day: this works with
>> x11vnc.
>> > Use the command xwininfo to find out the ID of the window to be
>> > shared, then use
>> > x11vnc -id {id number here}
>> > to share only one window to the vnc client.
>> >
>> > However cardboard-vnc-free is doing too much. First of all, it
>> > controls the moise pointer on the server (as a VNC client should)
>> but
>> > I don't need that. There is an option "Viewer" in the connection
>> > settings that will diable this and lower the latency from about 3
>> > seconds to 1 second.
>> >
>> > cardboard-vnc-free is also adding two viewports to the shared image,
>> > to fake a 3D. That's a show stopper, because I want to use the
>> stereo
>> > mode in GEM.
>> >
>> >> Another idea would be to use VLC on the android phone to open a
>> stream
>> >> that is sent by the computer via Pd/Gem and some way to cast the
>> stream.
>> >
>> > I think this is the way to go. It also has lower latency than a VNC
>> > connection.
>> >
>> > What's the best way to stream a GEM window, so that I can play this
>> > stream with VLC on the Android device?
>> I would say (if you are on linux) : use
>> https://github.com/umlaeute/v4l2loopback
>> <https://github.com/umlaeute/v4l2loopback> to create a virtual v4l2
>> device, then it's possible to use pix_record eventually in conjonction
>> with pix_snap to shoot Gem window and write it to this virtual v4l2
>> device (on my computer, it would involve to send a [codec v4l2<
>> message
>> to pix_record)
>> then you can stream to the Android device with ffmpeg fed by this v4l2
>> device and read it with vlc
>>
>> also possible to grab the Gem screen with ffmpeg -f x11grab +options
>>
>> ++
>> b
>> >
>> >
>> > M.
>> >
>> >
>> >
>> >> On 2017년 04월 01일 23:31, Alan Brooker wrote:
>> >>> Hey Max,
>> >>>
>> >>> Recently I have been looking at this very subject, in the end
>> using
>> >>> trinus vr (trinusvirtualreality.com
>> <http://trinusvirtualreality.com> <http://trinusvirtualreality.com
>> <http://trinusvirtualreality.com>>)
>> >>> on windows was the easiest solution for me
>> >>>
>> >>> I have tried something similar on linux (Fedora) but my problem
>> was
>> >>> just getting my PC to actually connect with my phone- this would
>> be
>> >>> trivial I assume for someone who is experienced setting up VNC
>> >>> connections/networking on Linux. So take a look at these and
>> good luck
>> >>>
>> >>>
>> https://play.google.com/store/apps/details?id=tantra.tantran
>> sha.cardboardremotedesktop.lite&hl=en
>> <https://play.google.com/store/apps/details?id=tantra.tantra
>> nsha.cardboardremotedesktop.lite&hl=en>
>> >>>
>> >>>
>> >>> http://www.vrbites.com/apps/cardboard-vnc-free/
>> <http://www.vrbites.com/apps/cardboard-vnc-free/>
>> >>>
>> >>> On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements at revolwear.com
>> <mailto:abonnements at revolwear.com>
>> >>> <mailto:abonnements at revolwear.com
>> <mailto:abonnements at revolwear.com>>> wrote:
>> >>>
>> >>> Hi list,
>> >>>
>> >>> I'm looking for a solution to use the gem output on an android
>> >>> phone
>> >>> for vr.
>> >>>
>> >>> I found this app, but it is windows only, no linux host.
>> >>> http://www.swatterco.com/vr_streamer.php
>> <http://www.swatterco.com/vr_streamer.php>
>> >>> <http://www.swatterco.com/vr_streamer.php
>> <http://www.swatterco.com/vr_streamer.php>>
>> >>>
>> >>> Any ideas about this?
>> >>>
>> >>> m.
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.puredata.info/pipermail/gem-dev/attachments/20170404/1171419b/attachment-0001.html>
More information about the GEM-dev
mailing list