Talk to sales
Pilot performance review in virtual reality (VR)

Case MetaVR: Using Eye Tracking for Pilot Performance Review

MetaVR is enriching pilot simulator training by using Varjo’s virtual and mixed reality headsets with built-in eye tracking. The result? Better learning outcomes.

In live pilot training exercises, the instructor can only assess the training mission based on its outcome. A lot of the subtle actions and reactions of the trainee can remain in the dark. For example – is the pilot's attention where needed during critical nanoseconds?

One of the most important deliverables of pilot mission simulator training is the ability to discuss and review air-to-air engagements in an after-action debrief. With Varjo and MetaVR, pilot performance can be assessed and reviewed more effectively.

Virtual and mixed reality simulator training with integrated eye tracking allows the instructor to review the trainee’s real-time performance in a highly accurate way. To expand on that capability, Varjo’s partner MetaVR has integrated a new, real-time eye tracking visualization capability for their simulators. The real-time visualization gives instructors the ability to review the pilot’s eye-gaze and head movement throughout air-to-air and air-to-ground simulated training exercises.

Varjo’s proprietary eye tracking at 200 Hz, integrated in both Varjo XR-3 and VR-3 headsets, can precisely capture even the smallest eye movement from training in VR and XR environments. Combined with MetaVR’s Virtual Reality Scene Generator version 6.6 software, instructors and trainees can depict each eye gaze as a color-coded 3D cone.

“With Varjo XR-3, pilots get the most natural and fully immersive training ever experienced. Bringing together the unique resolution and FOV of the Varjo XR-3 with our software offers a combined capability that is – we believe – unique to the current simulator training space.”

– Bert Haselden, Mixed-Reality Lead, MetaVR

Enriching pilot training without adding to the cognitive burden

With Varjo and MetaVR, a normally subjective process turns into a quantitative review, enabling instructor and trainee to analyse where the pilot’s head and eye movement were during an exercise. This helps understand where the pilot’s attention was, what leads to each outcome, identify areas for improvement, and track pilot progress throughout the training cycle.

What’s best, pilot training can be enriched without adding to the trainee’s cognitive burden. This can help achieve better learning outcomes and improved live missions down the line.

“The realistic simulation of flight scenarios in virtual and mixed reality is not science fiction. It’s here today already with Varjo XR-3, already producing tangible value for pilot training.” – Urho Konttori, Co-Founder and Chief Technology Officer, Varjo

To deep dive into the possibilities that VR and XR technology can bring to pilot training and flight simulation, download our complimentary in-depth e-book guide.

Learn more about using Varjo for training and simulation:

Whitepaper: Mixed and Virtual Reality for Pilot Training and Simulation

E-book

Jul 8, 2021

Webinar On Demand: How VRM Switzerland and Varjo Achieved the First EASA Qualified VR Flight Simulator

Webinar

Jun 8, 2021

Case Finnish Air Force: The Future of Pilot Training with LVC and Mixed Reality

Blog

Jan 29, 2021