CH.01 · Aerospace maintenance training
Mixed Reality Naval Maintenance Trainer
Gaze-driven HoloLens 2 trainer for F-18 maintenance procedures, with an agent pipeline that flags struggling trainees to supervisors.
Problem
F-18 maintenance trainees struggle with corrosion-detection procedures, and supervisors lack early signals when a trainee is falling behind.
Approach
HoloLens 2 training app with gaze-based interaction paired with an N8N + LLM agent pipeline that ingests xAPI data from a Learning Record Store, analyzes error patterns, and alerts supervisors for targeted intervention.
Role
Lead developer. Designed the gaze-based interaction model and built both the HoloLens 2 trainer and the xAPI analytics pipeline that drives supervisor alerts.
Overview
Advanced mixed reality training application for US NAVY maintenance procedures using HoloLens 2. Utilizes gaze detection for intuitive interaction. AI algorithms process xAPI performance data to generate predictive analytics on trainee proficiency, optimize training workflows, and recommend targeted interventions, leading to more efficient skill acquisition.