Talk to sales

Feature Preview: Real-time Mixed Reality Masking with Varjo Lab Tools

Take full control of the boundaries of mixed reality with Varjo’s new masking tool.

Direct capture from the Varjo XR-3 – See mixed reality masking in action

October 6, 2021 – Coming soon, Varjo users will gain access to brand new software features with ‘Varjo Lab Tools’, a suite of functionality to make rapid adjustments to virtual and mixed reality setups.

Included are new masking modes, for real-time masking of objects from a first-person perspective. Developers will be able to intuitively mark out the surface area of physical objects while wearing a Varjo XR-3 headset and looking at a real-life video pass-through feed.

Using handheld VR controllers, the surface area of the intended mask is indicated by pinpointing vertices directly onto real-world objects or areas, creating a polygonal 3D mesh.

In the restricted mode, shown in the video examples, the newly-created mask then acts as a window to the real world, showing an area of video pass-through within a virtual reality scenario. 

In this case, a physical steering wheel remains visible on top of a VR driving simulation. With the use of a Varjo Marker, the user can rotate the steering wheel and have the digital mask rotate accordingly. 

Multiple different masking modes can be selected to change how static and dynamic masks are treated within a mixed-reality view, including the use of chroma-key setups.

 

The full selection will unlock a whole new range of rapid experimentation for professionals working with XR.

 

In the examples, arm and hand occlusion powered by integrated Ultraleap hand tracking software, completes the mixed reality experience.

Further details on Varjo Lab Tools will launch alongside the next major update to Varjo Base as a standalone download. To be the first in the know about updates to Varjo’s hardware and software offerings, sign up for our newsletter. 

 

Subscribe to our newsletter

See latest product updates from Varjo

Varjo special event

Watch the Varjo XR-4 Launch Event On-Demand

Events

Nov 13, 2023

Varjo Adds Support for Leading 3D Engines to Its Varjo Reality Cloud Platform

Press Release

Nov 9, 2022

Webinar on Demand: The Future Has Arrived – Varjo Reality Cloud Launch Event

Webinar

May 4, 2022

Organizations

XR-4 and XR-4 Focal Edition are available in our web store and through selected Varjo resellers to business customers in nearly 40 countries.

Individuals

Private customers can order Aero through our selected Varjo resellers. Shipping to EU, Canada, Iceland, Norway, Switzerland, United Kingdom and United States.

Organizations

Business customers have access to our full product range.

Individuals

Private customers can order Aero through our selected Varjo resellers.