Preliminary testing of an augmented reality headset as a DICOM viewer during autopsy

Abstract

Objective: Augmented reality techniques are being used in clinical medicine and have been suggested for use in forensic medicine as well. In this article, we investigate the feasibility of using a head mounted AR display for conducting virtual autopsies and for augmenting autopsy under realistic conditions. Materials and Methods: For this study we used the Microsoft HoloLens (Microsoft Corp., Redmond, USA) as augmented reality device and DICOM-Viewer. We conducted this study in 2 phases with 5 participants. In phase 1, we conducted virtual autopsies on PMCT datasets using the AR device. In phase 2, participants performed 6 AR augmented autopsies. The time needed was recorded and the participants were interviewed about this new concept after each autopsy. Results: In phase 1 (AR Virtopsy), all participants were able to determine the main pathology for all cases, requiring an average of 122 seconds per case. Participants who expressed that they are more comfortable with technology were usually faster. In phase 2 (AR autopsy), most interactions happened in the first half an hour of the internal examination of the autopsy, with the interactions becoming less frequent and shorter over time. Conclusion: While AR headsets might not be useful to read and analyse CT images, AR headsets could help to bring image data such as PMCT into the autopsy hall. In such a scenario, this technology seems to be most useful in the first half an hour of the internal examination during autopsy.