Augmented reality in computer-assisted interventions based on patient-specific 3D printed reference

Healthcare Technology Letters

article

Rafael Moreta-Martinez¹  David García-Mato¹  Mónica García-Sevilla¹  Rubén Pérez-Mañanes²  José Calvo-Haro²  Javier Pascau¹ 

[1] Universidad Carlos III de Madrid;Instituto Investigación Sanitaria Gregorio Marañón;Hospital General Universitario Gregorio Marañón;Universidad Complutense de Madrid

关键词: cancer;    augmented reality;    tumours;    computerised tomography;    medical image processing;    surgery;    bone;    image registration;    paediatrics;    augmented reality;    computer-assisted interventions;    patient-specific 3D printed reference;    real-world spaces;    patient-specific tools;    visual pattern;    automatic registration;    placement errors;    software application;    actual surgical intervention;    tumour location;    surgical field;    extraosseous Ewing sarcoma;   

DOI  :  10.1049/htl.2018.5072

学科分类：肠胃与肝脏病学

来源: Wiley

【 摘 要 】

Augmented reality (AR) can be an interesting technology for clinical scenarios as an alternative to conventional surgical navigation. However, the registration between augmented data and real-world spaces is a limiting factor. In this study, the authors propose a method based on desktop three-dimensional (3D) printing to create patient-specific tools containing a visual pattern that enables automatic registration. This specific tool fits on the patient only in the location it was designed for, avoiding placement errors. This solution has been developed as a software application running on Microsoft HoloLens. The workflow was validated on a 3D printed phantom replicating the anatomy of a patient presenting an extraosseous Ewing's sarcoma, and then tested during the actual surgical intervention. The application allowed physicians to visualise the skin, bone and tumour location overlaid on the phantom and patient. This workflow could be extended to many clinical applications in the surgical field and also for training and simulation, in cases where hard body structures are involved. Although the authors have tested their workflow on AR head mounted display, they believe that a similar approach can be applied to other devices such as tablets or smartphones.

【 授权许可】

CC BY|CC BY-ND|CC BY-NC|CC BY-NC-ND