Talk to sales

Feature Preview: Real-time Mixed Reality Masking with Varjo Lab Tools

Take full control of the boundaries of mixed reality with Varjo’s new masking tool.

Direct capture from the Varjo XR-3 – See mixed reality masking in action

October 6, 2021 – Coming soon, Varjo users will gain access to brand new software features with ‘Varjo Lab Tools’, a suite of functionality to make rapid adjustments to virtual and mixed reality setups.

Included are new masking modes, for real-time masking of objects from a first-person perspective. Developers will be able to intuitively mark out the surface area of physical objects while wearing a Varjo XR-3 headset and looking at a real-life video pass-through feed.

Using handheld VR controllers, the surface area of the intended mask is indicated by pinpointing vertices directly onto real-world objects or areas, creating a polygonal 3D mesh.

In the restricted mode, shown in the video examples, the newly-created mask then acts as a window to the real world, showing an area of video pass-through within a virtual reality scenario. 

In this case, a physical steering wheel remains visible on top of a VR driving simulation. With the use of a Varjo Marker, the user can rotate the steering wheel and have the digital mask rotate accordingly. 

Multiple different masking modes can be selected to change how static and dynamic masks are treated within a mixed-reality view, including the use of chroma-key setups.

 

The full selection will unlock a whole new range of rapid experimentation for professionals working with XR.

 

In the examples, arm and hand occlusion powered by integrated Ultraleap hand tracking software, completes the mixed reality experience.

Further details on Varjo Lab Tools will launch alongside the next major update to Varjo Base as a standalone download. To be the first in the know about updates to Varjo’s hardware and software offerings, sign up for our newsletter. 

 

Subscribe to our newsletter

See latest product updates from Varjo

Varjo Adds Support for Leading 3D Engines to Its Varjo Reality Cloud Platform

Press Release

Nov 9, 2022

Webinar on Demand: The Future Has Arrived – Varjo Reality Cloud Launch Event

Webinar

May 4, 2022

Varjo Aero & Teleport VR Launch Event – Get the First Look

Product Update

Oct 21, 2021

Organizations

Business customers have access to our full product range:

  • Varjo XR-3
  • Varjo VR-3
  • Varjo Aero

Available in over 35 countries

Individuals

Private customers can order Aero through our webstore.

  • Varjo Aero

Shipping to Canada, EU, Iceland ,Switzerland, United Kingdom and United States.

Organizations

Business customers have access to our full product range.

Individuals

Private customers can order Aero through our webstore.