Feature Preview: Real-time Mixed Reality Masking with Varjo Lab Tools
Take full control of the boundaries of mixed reality with Varjo’s new masking tool.
October 6, 2021 – Coming soon, Varjo users will gain access to brand new software features with ‘Varjo Lab Tools’, a suite of functionality to make rapid adjustments to virtual and mixed reality setups.
Included are new masking modes, for real-time masking of objects from a first-person perspective. Developers will be able to intuitively mark out the surface area of physical objects while wearing a Varjo XR-3 headset and looking at a real-life video pass-through feed.
Using handheld VR controllers, the surface area of the intended mask is indicated by pinpointing vertices directly onto real-world objects or areas, creating a polygonal 3D mesh.
In the restricted mode, shown in the video examples, the newly-created mask then acts as a window to the real world, showing an area of video pass-through within a virtual reality scenario.
In this case, a physical steering wheel remains visible on top of a VR driving simulation. With the use of a Varjo Marker, the user can rotate the steering wheel and have the digital mask rotate accordingly.
Multiple different masking modes can be selected to change how static and dynamic masks are treated within a mixed-reality view, including the use of chroma-key setups.
The full selection will unlock a whole new range of rapid experimentation for professionals working with XR.
Further details on Varjo Lab Tools will launch alongside the next major update to Varjo Base as a standalone download. To be the first in the know about updates to Varjo’s hardware and software offerings, sign up for our newsletter.
