Header

UZH-Logo

Maintenance Infos

Dex-ray: augmented reality neurosurgical navigation with a handheld video probe


Kockro, R A; Tsai, Y T; Hwang, P; Zhu, C; Agusanto, K; Hong, L X; Serra, L (2009). Dex-ray: augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery, 65(4):795-807.

Abstract

OBJECTIVE: We developed an augmented reality system that enables intraoperative image guidance by using 3-dimensional (3D) graphics overlaid on a video stream. We call this system DEX-Ray and report on its development and the initial intraoperative experience in 12 cases. METHODS: DEX-Ray consists of a tracked handheld probe that integrates a lipstick-size video camera. The camera looks over the probe's tip into the surgical field. The camera's video stream is augmented with coregistered, multimodality 3D graphics and landmarks obtained during neurosurgical planning with 3D workstations. The handheld probe functions as a navigation device to view and point and as an interaction device to adjust the 3D graphics. We tested the system's accuracy in the laboratory and evaluated it intraoperatively with a series of tumor and vascular cases. RESULTS: DEX-Ray provided accurate and real-time video-based augmented reality display. The system could be seamlessly integrated into the surgical workflow. The see-through effect revealing 3D information below the surgically exposed surface proved to be of significant value, especially during the macroscopic phase of an operation, providing easily understandable structural navigational information. Navigation in deep and narrow surgical corridors was limited by the camera resolution and light sensitivity. CONCLUSION: The system was perceived as an improved navigational experience because the augmented see-through effect allowed direct understanding of the surgical anatomy beyond the visible surface and direct guidance toward surgical targets.

Abstract

OBJECTIVE: We developed an augmented reality system that enables intraoperative image guidance by using 3-dimensional (3D) graphics overlaid on a video stream. We call this system DEX-Ray and report on its development and the initial intraoperative experience in 12 cases. METHODS: DEX-Ray consists of a tracked handheld probe that integrates a lipstick-size video camera. The camera looks over the probe's tip into the surgical field. The camera's video stream is augmented with coregistered, multimodality 3D graphics and landmarks obtained during neurosurgical planning with 3D workstations. The handheld probe functions as a navigation device to view and point and as an interaction device to adjust the 3D graphics. We tested the system's accuracy in the laboratory and evaluated it intraoperatively with a series of tumor and vascular cases. RESULTS: DEX-Ray provided accurate and real-time video-based augmented reality display. The system could be seamlessly integrated into the surgical workflow. The see-through effect revealing 3D information below the surgically exposed surface proved to be of significant value, especially during the macroscopic phase of an operation, providing easily understandable structural navigational information. Navigation in deep and narrow surgical corridors was limited by the camera resolution and light sensitivity. CONCLUSION: The system was perceived as an improved navigational experience because the augmented see-through effect allowed direct understanding of the surgical anatomy beyond the visible surface and direct guidance toward surgical targets.

Statistics

Altmetrics

Downloads

482 downloads since deposited on 18 Mar 2010
73 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > University Hospital Zurich > Clinic for Neurosurgery
Dewey Decimal Classification:610 Medicine & health
Language:English
Date:April 2009
Deposited On:18 Mar 2010 08:25
Last Modified:07 Dec 2017 01:34
Publisher:Lippincott Wiliams & Wilkins
ISSN:0148-396X
Publisher DOI:https://doi.org/10.1227/01.NEU.0000349918.36700.1C
Official URL:http://journals.lww.com/neurosurgery/toc/2009/10000
PubMed ID:19834386

Download

Download PDF  'Dex-ray: augmented reality neurosurgical navigation with a handheld video probe'.
Preview
Filetype: PDF
Size: 2MB
View at publisher