Work

Design of interactive augmented reality functions for robotic surgery and evaluation in dry‐lab lymphadenectomy

Year: 2021

Type: article

Abstract: BACKGROUND: Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot-assisted minimally invasive surgery has mainly focussed on superimposing preoperative three-dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery. METHODS: We designed, built and evaluated four voice-controlled functions: viewing a live video of the operating room, viewing two-dimensional preoperative images, measuring 3D distances and warning about out-of-view instruments. This low-cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer. RESULTS: Eight experienced surgeons performed dry-lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands. CONCLUSIONS: The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration.

Source: International Journal of Medical Robotics and Computer Assisted Surgery

DOI: 10.1002/rcs.2351

Authors: Maria‐Paola Forte, Ravali Gourishetti, Bernard Javot, Tobias Engler, Ernest D. Gomez, Katherine J. Kuchenbecker

Institutions: Max Planck Institute for Intelligent Systems, Universitätsklinikum Tübingen, Beth Israel Deaconess Medical Center, Harvard University

Language: English

Topic: Augmented Reality Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

SDG: Good health and well-being

Open Access status: hybrid

Estimated APC paid: $3,400