Assessing performance of augmented reality-based neurosurgical training

Visual Computing for Industry, Biomedicine, and Art

  ^{1    2    3    3    3    3    4} 

[1] 0000 0000 8877 7471, grid.284723.8, Department of Neurosurgery, Zhujiang Hospital, Southern Medical University, 510282, Guangzhou, China;0000 0004 1937 0482, grid.10784.3a, Department of Computer Science and Engineering, the Chinese University of Hong Kong, Hong Kong, China;0000000119573309, grid.9227.e, Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Avenue, Shenzhen University Town, 518055, Shenzhen, China;0000000119573309, grid.9227.e, Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, 1068 Xueyuan Avenue, Shenzhen University Town, 518055, Shenzhen, China;E.N.T.department of Shenzhen University General Hospital, 518055, Shenzhen, China;

关键词: Augmented reality;    Personalized virtual operative anatomy;    Neurosurgical training;   

DOI  :  10.1186/s42492-019-0015-8

来源: publisher

【 摘 要 】

This paper presents a novel augmented reality (AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills. Surgical simulation with bimanual haptic interaction is integrated in this work to provide a simulated environment for users to achieve holographic guidance for pre-operative training. To achieve the AR guidance, the simulator should precisely overlay the 3D anatomical information of the hidden target organs in the patients in real surgery. In this regard, the patient-specific anatomy structures are reconstructed from segmented brain magnetic resonance imaging. We propose a registration method for precise mapping of the virtual and real information. In addition, the simulator provides bimanual haptic interaction in a holographic environment to mimic real brain tumor resection. In this study, we conduct AR-based guidance validation and a user study on the developed simulator, which demonstrate the high accuracy of our AR-based neurosurgery simulator, as well as the AR guidance mode’s potential to improve neurosurgery by simplifying the operation, reducing the difficulty of the operation, shortening the operation time, and increasing the precision of the operation.

【 授权许可】

CC BY