3D Engine Bay Scanning & Tracking
Full pipeline for turning a physical engine bay into a tracked XR experience: scan, optimize, register, and overlay on the real hardware. Domain: Automotive XR.
The challenge
Technicians training on engine bays lack spatially accurate, hands-free guidance tied to the real asset in front of them.
The approach
End-to-end pipeline: scan the physical engine bay to mesh, optimize for HoloLens 2, and register spatial tracking so MRTK-based overlays align to the real hardware.
About this project
Demonstration of the complete workflow for creating an XR engine bay experience using the HoloLens 2
Technology and methods
- HoloLens 2
- Unity3D
- MRTK2
- 3D Scanning
Related work
- HoloLens 2 Knee Replacement Surgery Guide - Mixed reality training app that walks medical students through total knee replacement in 3D, adapting to their decisions in real time.
- Mixed Reality Naval Maintenance Trainer - Gaze-driven HoloLens 2 trainer for F-18 maintenance procedures, with an agent pipeline that flags struggling trainees to supervisors.
- Live IoT Data in Mixed Reality - HoloLens 2 app that pairs a virtual drone with live MQTT sensor streams, showing environmental telemetry beside the physical asset.