Gesture-controlled interactive three dimensional anatomy: a novel teaching tool in head and neck surgery

Journal of Otolaryngology-Head & Neck Surgery

Sabine Hombach-Klonisch⁵  Justyn Pisa²  Jay Kraut⁴  Bertram Unger¹  Jordan B Hochman³ 

[1] Clinical Learning and Simulation Facility, Department of Medical Education, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba, Canada;Department of Otolaryngology - Head and Neck Surgery, Health Sciences Centre, Surgical Hearing Implant Program, GB421, 820 Sherbrook Street, Winnipeg, Manitoba, Canada;Neurotologic Surgery, Department of Otolaryngology - Head and Neck Surgery, Faculty of Medicine, University of Manitoba, GB421, 820 Sherbrook Street, Winnipeg, Manitoba, Canada;Department of Medical Education, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba, Canada;Department of Human Anatomy and Cell Science, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba, Canada

关键词: Temporal bone;    Haptic;    Virtual reality;    Gesture controlled;    3D model;    Interactive;   

Others  :  1143925
DOI  :  10.1186/s40463-014-0038-2

 received in 2014-01-28, accepted in 2014-09-22,  发布年份 2014

【 摘 要 】

Background

There is a need for innovative anatomic teaching tools. This paper describes a three dimensional (3D) tool employing the Microsoft Kinect¿. Using this instrument, 3D temporal bone anatomy can be manipulated with the use of hand gestures, in the absence of mouse or keyboard.

Methods

CT Temporal bone data is imported into an image processing program and segmented. This information is then exported in polygonal mesh format to an in-house designed 3D graphics engine with an integrated Microsoft Kinect¿. Motion in the virtual environment is controlled by tracking hand position relative to the user¿s left shoulder.

Results

The tool successfully tracked scene depth and user joint locations. This permitted gesture-based control over the entire 3D environment. Stereoscopy was deemed appropriate with significant object projection, while still maintaining the operator¿s ability to resolve image details. Specific anatomical structures can be selected from within the larger virtual environment. These structures can be extracted and rotated at the discretion of the user. Voice command employing the Kinect¿s¿ intrinsic speech library was also implemented, but is easily confounded by environmental noise.

Conclusion

There is a need for the development of virtual anatomy models to complement traditional education. Initial development is time intensive. Nonetheless, our novel gesture-controlled interactive 3D model of the temporal bone represents a promising interactive teaching tool utilizing a novel interface.

【 授权许可】

   
2014 Hochman et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

【 参考文献 】

• [1]Yeung JC, Fung K, Wilson TD: Development of a computer-assisted cranial nerve simulation from the visible human dataset. Anat Sci Educ 2011, 4(2):92-97.
• [2]Venail F, Deveze A, Lallemant B, Guevara N, Mondain M: Enhancement of temporal bone anatomy learning with computer 3D rendered imaging software. Med Teach 2010, 32(7):e282-e288.
• [3]Nicholson DT, Chalk C, Funnell WR, Daniel SJ: Can virtual reality improve anatomy education? A randomised controlled study of a computer-generated three-dimensional anatomical ear model. Med Educ 2006, 40(11):1081-1087.
• [4]Glittenberg C, Binder S: Using 3D computer simulations to enhance ophthalmic training. Ophthalmic Physiol Opt 2006, 26(1):40-49.
• [5]Nance ET, Lanning SK, Gunsolley JC: Dental anatomy carving computer-assisted instruction program: an assessment of student performance and perceptions. J Dent Educ 2009, 73(8):972-979.
• [6]Agur AMR, Lee MJ, Anderson JE: Grant¿s Atlas of Anatomy. Williams & Wilkins, Baltimore; 1991.
• [7]Netter FH, Colacino S: Atlas of Human Anatomy. Novartis, East Hanover; 1997.
• [8]Gray H, Williams PL, Bannister LH: Gray¿s Anatomy: The Anatomical Basis of Medicine and Surgery. Churchill Livingstone, New York; 1995.
• [9]Garg AX, Norman G, Sperotable L: How medical students learn spatial anatomy. Lancet 2001, 357(9253):363-364.
• [10]Temkin B, Acosta E, Malvankar A, Vaidyanath S: An interactive three-dimensional virtual body structures system for anatomical training over the internet. Clin Anat 2006, 19(3):267-274.
• [11]George AP, De R: Review of temporal bone dissection teaching: how it was, is and will be. J Laryngol Otol 2010, 124(2):119-125.
• [12]Fried MP, Uribe JI, Sadoughi B: The role of virtual reality in surgical training in otorhinolaryngology. Curr Opin Otolaryngol Head Neck Surg 2007, 15(3):163-169.
• [13]Schubert O, Sartor K, Forsting M, Reisser C: Three-dimensional computed display of otosurgical operation sites by spiral CT. Neuroradiology 1996, 38(7):663-668.
• [14]Rodt T, Sartor K, Forsting M, Reisser C: 3D visualisation of the middle ear and adjacent structures using reconstructed multi-slice CT datasets, correlating 3D images and virtual endoscopy to the 2D cross-sectional images. Neuroradiology 2002, 44(9):783-790.
• [15]Turmezei TD, Tam MD, Loughna S: A survey of medical students on the impact of a new digital imaging library in the dissection room. Clin Anat 2009, 22(6):761-769.
• [16]Lufler RS, Zumwalt AC, Romney CA, Hoagland TM: Incorporating radiology into medical gross anatomy: does the use of cadaver CT scans improve students¿ academic performance in anatomy? Anat Sci Educ 2010, 3(2):56-63.
• [17]Luursema J-M, Zumwalt AC, Romney CA, Hoagland TM: The role of steropsis in virtual anatomic learning. Interacting with Comput 2008, 20:455-460.
• [18]Jacobson S, Epstein SK, Albright S, Ochieng J, Griffiths J, Coppersmith V, Polak JF: Creation of virtual patients from CT images of cadavers to enhance integration of clinical and basic science student learning in anatomy. Med Teach 2009, 31(8):749-751.
• [19]Hisley KC, Anderson LD, Smith SE, Kavic SM, Tracy JK: Coupled physical and digital cadaver dissection followed by a visual test protocol provides insights into the nature of anatomical knowledge and its evaluation. Anat Sci Educ 2008, 1(1):27-40.
• [20]Petersson H, Sinkvist D, Wang C, Smedby O: Web-based interactive 3D visualization as a tool for improved anatomy learning. Anat Sci Educ 2009, 2(2):61-68.
• [21]Crossingham JL, Jenkinson J, Woolridge N, Gallinger S, Tait GA, Moulton CA: Interpreting three-dimensional structures from two-dimensional images: a web-based interactive 3D teaching model of surgical liver anatomy. HPB (Oxford) 2009, 11(6):523-528.
• [22]Rodt T, Burmeister HP, Bartling S, Kaminsky J, Schwab B, Kikinis R, Backer H: 3D-Visualisation of the middle ear by computer-assisted post-processing of helical multi-slice CT data. Laryngorhinootologie 2004, 83(7):438-444.
• [23]Gould DJ, Terrell MA, Fleming J: A usability study of users¿ perceptions toward a multimedia computer-assisted learning tool for neuroanatomy. Anat Sci Educ 2008, 1(4):175-183.
• [24]Yip GW, Rajendran K: SnapAnatomy, a computer-based interactive tool for independent learning of human anatomy. J Vis Commun Med 2008, 31(2):46-50.
• [25]Trelease RB, Rosset A: Transforming clinical imaging data for virtual reality learning objects. Anat Sci Educ 2008, 1(2):50-55.
• [26]Nguyen N, Wilson TD: A head in virtual reality: development of a dynamic head and neck model. Anat Sci Educ 2009, 2(6):294-301.
• [27]Vazquez PP: An interactive 3D framework for anatomical education. Int J Comput-Assist Radiol Surg 2008, 3:511-524.
• [28]Hariri S, Rawn C, Srivastava S, Youngblood P, Ladd A: Evaluation of a surgical simulator for learning clinical anatomy. Med Educ 2004, 38(8):896-902.
• [29]Brenton H: Using multimedia and Web3D to enhance anatomy teaching. Comput Educ 2007, 49(1):32-53.
• [30]McRackan TR, Reda FA, Rivas A, Noble JH, Dietrich MS, Dawant BM, Labadie RF: Comparison of cochlear implant relevant anatomy in children versus adults. Otol Neurotol 2012, 33(3):328-334.
• [31]Reda FA, Noble JH, Rivas A, McRackan TR, Labadie RF, Dawant BM: Automatic segmentation of the facial nerve and chorda tympani in pediatric CT scans. Med Phys 2011, 38(10):5590-5600.