Transforming Surgical Training with AR-Technology

Transforming Surgical Training with AR-Technology

The PROFICIENCY project, funded by Innosuisse, seeks to revolutionize the traditional "see one, do one, teach one" model of surgical education by integrating advanced technologies such as Augmented Reality (AR) and simulation tools.

In collaboration with ETH Zurich, ZHAW, and clinical partners, Balgrist University Hospital is developing innovative training programs aimed at enhancing the skills of surgical residents while aligning with modern technological advancements. A key component of the project is an AR-enabled simulator for total hip arthroplasty, developed and tested at OR-X. This hybrid training tool combines real instruments and specimen-based practice with AR visualizations, allowing surgeons to see anatomical details and possible complications in real-time. The AR glasses guide surgeons through each step of the procedure, offering precise instructions and support tailored to their skill level. The use of OR-X's realistic surgical environment is essential in refining this system and ensuring it meets the demands of clinical application, ultimately saving time and resources while improving surgical outcomes.

Cutting-Edge Visualization and Evaluation

At OR-X, advanced multi-camera systems capture surgeries to create photorealistic 3D reconstructions. These detailed visualizations, paired with AI-driven performance tracking, offer a more immersive learning experience and allow for precise feedback on surgical accuracy. Trainees can replay critical steps of a procedure, practice them virtually, and receive objective assessments of their performance based on tool, hand, and eye-tracking data. By incorporating these innovative tools into surgical education, PROFICIENCY is laying the groundwork for a more efficient and data-driven approach to training future surgeons, enhancing both technical skills and spatial understanding.