Virtual Reality
Daniele Pillan
Add the possibility to see Eyeshot viewport in a Virtual reality headset (HTC Vive). Can be done with a VR plugin or integrating directly the SDK.
4
Comments
I add some links as starting point for this new feature:
https://developer.vive.com/resources/viveport/sdk/documentation/english/viveport-sdk/
https://github.com/ViveportSoftware/viveport_sdk_csharp/tree/master/source/Viveport.TestProgram
As final result I give an example of CAD application for robots using VR:
https://www.youtube.com/watch?v=WSjgxzgOLLw
When I will find more doc I will add it!
Probably this is the best doc:
https://github.com/ValveSoftware/openvr/wiki/API-Documentation
It explain how to use the API OpenVR to communicate with SteamVR that directly communicate with the hardware.
"One real-world example of an application is a game engine like Unity. Unity calls OpenVR API to get the position and orientation of any attached VR headset and apply them to the Main Camera. Unity then sends the camera image to OpenVR. "
I found a full example of C++ and OpenGL that run without problem and I had been able to see and modify a scene on my VR Headset:
https://github.com/ValveSoftware/openvr
you can make it work right now with most headset. Just export to web, Grab the 3js code and export to GLTF and it works.
Thank you Francis, I will give a look to threejs and to GLTF format. I wonder if it is possible to do all those conversions during an animation and still get a fluid experience in VR.
To add some update on the subject I am currently looking at a very promising project called Stereo Kit (https://stereokit.net/). It does AR and VR and It's very simple to use. Seems to support many different headset (HoloLens 2, Oculus Quest, Windows Mixed Reality, Oculus Desktop, SteamVR, Monado Linux). Also the file format is interesting : .gltf, .glb, .fbx(partial), .obj, .stl, procedural
Mostly looking at obj or STL for much faster processing. Seems like a good natural integration between Eyeshot and that tool.
This Stereokit is very interesting! It seems it is enough to apply the same transformations computed for Eyeshot entities to a StereoKit Model and the animation is done. We will try it, thanks Francis.
I made advancement on this. We just tried this last Monday and we bought on steam for like 5$ the following app that work with most headset.
https://store.steampowered.com/app/891420/VR_Model_Viewer/
Then we simply exported our 3d model from eyeshot to OBJ which does properly include texture files with it and it works like a charm. It has some issues loading larger file (7gb ++) but we could split the models into multiple smaller files and import then separately and merge them in the viewer.
It's not perfect for shadown
Francis, what headset are you using?
Right now we are testing with a HP Reverb G2 which is part of the Windows Mixed Reality brand.
Please sign in to leave a comment.