Augmented Reality to Localize Individual Organ in Surgical Procedure

Healthcare Informatics Research

Dongheon Lee¹  Jeeyoung Hong¹  Hyoun-Joong Kong²  Jin Wook Yi³  Young Jun Chai⁴  Hee Chan Kim⁵ 

[1] Biomedical Research Institute, Seoul National University Hospital, Seoul, .Korea;Department of Biomedical Engineering, Chungnam National University Hospital, Chungnam National University College of Medicine, Daejeon, .Korea;Department of Surgery, Inha University Hospital, Incheon, .Korea;Department of Surgery, SMGSNU Boramae Medical Center, Seoul, .Korea;Institute of Medical & Biological Engineering, Medical Research Center, Seoul National University College of Medicine, Seoul, .Korea;

关键词: virtual reality;    medical education;    three-dimensional imaging;    thyroidectomy;    augmented reality;   

DOI  :  10.4258/hir.2018.24.4.394

来源: DOAJ

【 摘 要 】

ObjectivesAugmented reality (AR) technology has become rapidly available and is suitable for various medical applications since it can provide effective visualization of intricate anatomical structures inside the human body. This paper describes the procedure to develop an AR app with Unity3D and Vuforia software development kit and publish it to a smartphone for the localization of critical tissues or organs that cannot be seen easily by the naked eye during surgery.MethodsIn this study, Vuforia version 6.5 integrated with the Unity Editor was installed on a desktop computer and configured to develop the Android AR app for the visualization of internal organs. Three-dimensional segmented human organs were extracted from a computerized tomography file using Seg3D software, and overlaid on a target body surface through the developed app with an artificial marker.ResultsTo aid beginners in using the AR technology for medical applications, a 3D model of the thyroid and surrounding structures was created from a thyroid cancer patient's DICOM file, and was visualized on the neck of a medical training mannequin through the developed AR app. The individual organs, including the thyroid, trachea, carotid artery, jugular vein, and esophagus were localized by the surgeon's Android smartphone.ConclusionsVuforia software can help even researchers, students, or surgeons who do not possess computer vision expertise to easily develop an AR app in a user-friendly manner and use it to visualize and localize critical internal organs without incision. It could allow AR technology to be extensively utilized for various medical applications.

【 授权许可】

Unknown