Augmented Reality for
Surgical Guidance

HW & SW solutions for AR-guided manual procedures in surgical and industrial contexts

Health Industry

Augmented reality overlay during surgical procedure — Università di Pisa AR research

Research overview

Application field	Health, Industry
Technology	Head Mounted Displays, AR Projectors, Optical and Electromagnetic tracking
Activity	Surgical navigation and surgical simulation

Keywords

Augmented Reality HMDs Tracking Registration Machine Vision Surgical Navigation Surgical Simulation

Operation of the proposed solution

HW and SW solutions already tested during real interventions have been developed to guide manual procedures with precision. The distinctive feature of the HMD system is its ability to offer both Optical See-Through (OST) and Video See-Through (VST) view on the same device, allowing the user to quickly switch from an accurate to a comfortable view and vice versa.

For AR information related to the surface, a projected AR view is also available, broadening the applicability across surgical and industrial environments.

Open challenges

1 Extending human performance during manual precision tasks through ergonomic use of Augmented Reality

Selected bibliography

Condino S., Montemurro N., Cattari N. et al. “Evaluation of a Wearable AR Platform for Guiding Complex Craniotomies in Neurosurgery.” Annals of Biomedical Engineering 2021
doi.org/10.1007/s10439-021-02834-8

Video