CH.01 · Medical training
HoloLens 2 Knee Replacement Surgery Guide
Mixed reality training app that walks medical students through total knee replacement in 3D, adapting to their decisions in real time.
Problem
Med students learning total knee replacement lack a spatial, interactive rehearsal environment that adapts to their decisions in real time.
Approach
HoloLens 2 / MRTK2 training app with an integrated Claude-powered cognitive agent over a custom surgical knowledge base, delivering step-by-step procedural guidance and live feedback on technique.
Role
Lead developer. Built the HoloLens 2 application end to end - spatial interaction, procedural flow, and the Claude-backed guidance agent over the surgical knowledge base.
Overview
An immersive mixed reality training application for medical students learning total knee replacement. Built with Unity3D and MRTK2 for HoloLens 2, this interactive guide features AI-powered procedural assistance, offering real-time feedback on technique and decision-making. Provides step-by-step visualization of surgical procedures in 3D space, dynamically adapting to user performance and queries through an integrated cognitive AI.