This paper is centered on the design, implementation, and evaluation of our platform app. The app serves as the practical application of the concepts and methodologies discussed throughout the paper. Through a structured user study, we were able to validate the app’s effectiveness in real-world educational contexts. Specifically, the study compared the app’s performance to traditional educational methods, focusing on metrics such as engagement, learning efficiency, and user satisfaction. The results provide empirical evidence supporting the app’s potential as a more efficient and user-friendly alternative to conventional learning tools.

Abstract

Surgical training integrates several years of didactic learning, simulation, mentorship, and hands-on experience. Challenges include stress, technical demands, and new tech- nologies. Orthopedic education often uses static materials like books, images, and videos, lacking interactivity. This study compares a new interactive photorealistic 3D visualiza- tion to 2D videos for learning total hip arthroplasty. In a randomized controlled trial, participants (students and residents) were evaluated on spatial awareness, tool placement, and task times in a simulation. Results show that interactive photorealistic 3D visual- ization significantly improved scores, with residents and those with prior 3D experience performing better. These results emphasize the potential of the interactive photorealistic 3D visualization to enhance orthopedic training.

The User Study

This study shows that an interactive 3D tool outperforms standard 2D videos in teaching total hip arthroplasty, especially for residents and users with prior 3D experience.

Tutorial: Guided walkthrough with a mini-game to learn how to use the tool.	Target Tool and Bone: Showcasing accurate instrument positioning.
Interactive Visualization: A 3D model with navigable and toggleable anatomical structures.	Flyover Video: A dynamic, non-interactive video of a surgical step with labeled anatomical structures.

BibTeX

@inproceedings{lekarOrthopedicVisualization,
  title     = {Enhancing Orthopedic Surgical Training With Interactive Photorealistic 3D Visualization},
  author    = {Roni Lekar and Tatiana Gerth and Sergey Prokudin and Matthias Seibold and Reto Bürgin and Benjamin Vella and Armando Hoch and Siyu Tang and Philipp Fürnstahl and Helmut Grabner},
  booktitle = {Proceedings of CAOS 2025},
  year      = {2025},
  institution = {Zurich University of Applied Sciences, ETH Zurich, Balgrist University Hospital, University of Zurich},
}
        

Surgical Training Platform

Building on insights from the paper and user study, we have created a portal that showcases the features and capabilities of this advanced application. We encourage you to try the demo web version or download the full executable file. Within this portal, you can explore total hip surgery by watching a video of the procedure or by interacting with and navigating through points of interest in photorealistic 3D.

Try now