Calling all academic institutions: Special offer on the Varjo XR-4 Series available until Dec 15. Apply now.

Talk to sales

Feature Preview: Real-time Mixed Reality Masking with Varjo Lab Tools

Take full control of the boundaries of mixed reality with Varjo’s new masking tool.

Direct capture from the Varjo XR-3 – See mixed reality masking in action

October 6, 2021 – Coming soon, Varjo users will gain access to brand new software features with ‘Varjo Lab Tools’, a suite of functionality to make rapid adjustments to virtual and mixed reality setups.

Included are new masking modes, for real-time masking of objects from a first-person perspective. Developers will be able to intuitively mark out the surface area of physical objects while wearing a Varjo XR-3 headset and looking at a real-life video pass-through feed.

Using handheld VR controllers, the surface area of the intended mask is indicated by pinpointing vertices directly onto real-world objects or areas, creating a polygonal 3D mesh.

In the restricted mode, shown in the video examples, the newly-created mask then acts as a window to the real world, showing an area of video pass-through within a virtual reality scenario. 

In this case, a physical steering wheel remains visible on top of a VR driving simulation. With the use of a Varjo Marker, the user can rotate the steering wheel and have the digital mask rotate accordingly. 

Multiple different masking modes can be selected to change how static and dynamic masks are treated within a mixed-reality view, including the use of chroma-key setups.

 

The full selection will unlock a whole new range of rapid experimentation for professionals working with XR.

 

In the examples, arm and hand occlusion powered by integrated Ultraleap hand tracking software, completes the mixed reality experience.

Further details on Varjo Lab Tools will launch alongside the next major update to Varjo Base as a standalone download. To be the first in the know about updates to Varjo’s hardware and software offerings, sign up for our newsletter. 

 

Subscribe to our newsletter

See latest product updates from Varjo

The Varjo XR-4 Series Is Now Officially OpenXR 1.0 Compliant

Product Update

Sep 26, 2024

Varjo special event

Watch the Varjo XR-4 Launch Event On-Demand

Events

Nov 13, 2023

Varjo Adds Support for Leading 3D Engines to Its Varjo Reality Cloud Platform

Press Release

Nov 9, 2022