The McGill simulator for endoscopic sinus surgery (MSESS): a validation study

Journal of Otolaryngology-Head & Neck Surgery

National Research Council Canada¹  Marc A Tewfik³  W Robert J Funnell⁴  Elias Saad⁴  Anthony Zeitouni³  Rolando Del Maestro⁶  Meredith Young⁵  Lily HP Nguyen⁷  Saul Frenkiel³  Rickul Varshney² 

[1] National Research Council Canada, Boucherville, Canada;Royal Victoria Hospital, 687 Ave Des Pins O., Rm E4.41, Montreal H3A 1A1, Quebec, Canada;Department of Otolaryngology, Head and Neck Surgery, McGill University, Montreal, Canada;Department of BioMedical Engineering, McGill University, Montreal, Canada;Department of Medicine, McGill University, Montreal, Canada;Neurosurgical Simulation Research Center, McGill University, Montreal, Canada;Centre for Medical Education, McGill University, Montreal, Canada

关键词: Nasal model;    Performance metrics;    Technical abilities;    Haptic;    Minimally invasive surgery;    Resident;    Virtual reality;    Simulation;    Education;    Training;    Endoscopic sinus surgery;    Rhinology;   

Others  :  1143921
DOI  :  10.1186/s40463-014-0040-8

 received in 2014-06-25, accepted in 2014-10-15,  发布年份 2014

【 摘 要 】

Background

Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.

Methods

10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.

Results

The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97?±?0.29 and 8.57?±?0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (p?p?p?

Conclusion

The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.

【 授权许可】

   
2014 Varshney et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

【 参考文献 】

• [1]Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP: Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 2005, 131:217-221.
• [2]Fried MP, Satava R, Weghorst S, Gallagher AG, Sasaki C, Ross D, Sinanan M, Uribe JI, Zeltsan M, Arora H, Cuellar H: Identifying and reducing errors with surgical simulation. Qual Saf Health Care 2004, 13(Suppl 1):i19-i26.
• [3]Fried MP, Sadoughi B, Gibber MJ, Jacobs JB, Lebowitz RA, Ross DA, Bent JP 3rd, Parikh SR, Sasaki CT, Schaefer SD: From virtual reality to the operating room: the endoscopic sinus surgery simulator experiment. Otolaryngol Head Neck Surg 2010, 142:202-207.
• [4]Gross RD, Sheridan MF, Burgess LP: Endoscopic sinus surgery complications in residency. Laryngoscope 1997, 107:1080-1085.
• [5]Neubauer A, Wolfsberger S, Forster MT, Mroz L, Wegenkittl R, Buhler K: Advanced virtual endoscopic pituitary surgery. IEEE Trans Vis Comput Graph 2005, 11:497-507.
• [6]Joice P, Ross PD, Wang D, Abel EW, White PS: Measurement of osteotomy force during endoscopic sinus surgery. Allergy Rhinol 2012, 3:e61-e65.
• [7]Zhao YC, Kennedy G, Yukawa K, Pyman B, O'Leary S: Can virtual reality simulator be used as a training aid to improve cadaver temporal bone dissection? Results of a randomized blinded control trial. Laryngoscope 2011, 121:831-837.
• [8]Hogle NJ, Widmann WD, Ude AO, Hardy MA, Fowler DL: Does training novices to criteria and does rapid acquisition of skills on laparoscopic simulators have predictive validity or are we just playing video games? J Surg Educ 2008, 65:431-435.
• [9]Fried MP, Sadoughi B, Weghorst SJ, Zeltsan M, Cuellar H, Uribe JI, Sasaki CT, Ross DA, Jacobs JB, Lebowitz RA, Satava RM: Construct validity of the endoscopic sinus surgery simulator: II. Assessment of discriminant validity and expert benchmarking. Arch Otolaryngol Head Neck Surg 2007, 133:350-357.
• [10]Beyer L, Troyer JD, Mancini J, Bladou F, Berdah SV, Karsenty G: Impact of laparoscopy simulator training on the technical skills of future surgeons in the operating room: a prospective study. Am J Surg 2011, 202:265-272.
• [11]Seymour NE, Gallagher AG, Roman SA, O'Brien MK, Bansal VK, Andersen DK, Satava RM: Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 2002, 236:458-463. discussion 463-454
• [12]Park J, MacRae H, Musselman LJ, Rossos P, Hamstra SJ, Wolman S, Reznick RK: Randomized controlled trial of virtual reality simulator training: transfer to live patients. Am J Surg 2007, 194:205-211.
• [13]Francis HW, Malik MU, Diaz Voss Varela DA, Barffour MA, Chien WW, Carey JP, Niparko JK, Bhatti NI: Technical skills improve after practice on virtual-reality temporal bone simulator. Laryngoscope 2012, 122:1385-1391.
• [14]Zhao YC, Kennedy G, Yukawa K, Pyman B, O'Leary S: Improving temporal bone dissection using self-directed virtual reality simulation: results of a randomized blinded control trial. Otolaryngol Head Neck Surg 2011, 144:357-364.
• [15]Wiet GJ, Stredney D, Wan D: Training and simulation in otolaryngology. Otolaryngol Clin North Am 2011, 44:1333-1350. viii-ix
• [16]Caversaccio M, Eichenberger A, Hausler R: Virtual simulator as a training tool for endonasal surgery. Am J Rhinol 2003, 17:283-290.
• [17]Tolsdorff B, Pommert A, Hohne KH, Petersik A, Pflesser B, Tiede U, Leuwer R: Virtual reality: a new paranasal sinus surgery simulator. Laryngoscope 2010, 120:420-426.
• [18]Delorme S, Laroche D, DiRaddo R, Del Maestro RF: NeuroTouch: a physics-based virtual simulator for cranial microneurosurgery training. Neurosurgery 2012, 71:32-42.
• [19]Rosseau G, Bailes J, del Maestro R, Cabral A, Choudhury N, Comas O, Debergue P, De Luca G, Hovdebo J, Jiang D, Laroche D, Neubauer A, Pazos V, Thibault F, Diraddo R: The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. Neurosurgery 2013, 73(Suppl 1):85-93.
• [20]Gelinas-Phaneuf N, Choudhury N, Al-Habib AR, Cabral A, Nadeau E, Mora V, Pazos V, Debergue P, Diraddo R, Del Maestro RF: Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assist Radiol Surg 2013, 9(1):1-9.
• [21]Stankiewicz J: Complications of microdebriders in endoscopic nasal and sinus surgery. Curr Opin Otolaryngol Head Neck Surg 2002, 10:26-28.
• [22]Hofstad EF, Vapenstad C, Chmarra MK, Lango T, Kuhry E, Marvik R: A study of psychomotor skills in minimally invasive surgery: what differentiates expert and nonexpert performance. Surg Endosc 2013, 27:854-863.
• [23]Pellen MG, Horgan LF, Barton JR, Attwood SE: Construct validity of the ProMIS laparoscopic simulator. Surg Endosc 2009, 23:130-139.
• [24]Edmond CV Jr: Impact of the endoscopic sinus surgical simulator on operating room performance. Laryngoscope 2002, 112:1148-1158.
• [25]Bakker NH, Fokkens WJ, Grimbergen CA: Investigation of training needs for functional endoscopic sinus surgery (FESS). Rhinology 2005, 43:104-108.
• [26]Hung AJ, Ng CK, Patil MB, Zehnder P, Huang E, Aron M, Gill IS, Desai MM: Validation of a novel robotic-assisted partial nephrectomy surgical training model. BJU Int 2012, 110:870-874.
• [27]Narazaki K, Oleynikov D, Stergiou N: Objective assessment of proficiency with bimanual inanimate tasks in robotic laparoscopy. J Laparoendosc Adv Surg Tech A 2007, 17:47-52.
• [28]Downing SM: Validity: on meaningful interpretation of assessment data. Med Educ 2003, 37:830-837.
• [29]Rivard JD, Vergis AS, Unger BJ, Hardy KM, Andrew CG, Gillman LM, Park J: Construct validity of individual and summary performance metrics associated with a computer-based laparoscopic simulator. Surg Endosc 2014, 28(6):1921-1928.
• [30]Lin Y, Wang X, Wu F, Chen X, Wang C, Shen G: Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. J Biomed Inform 2013, 48:122-129.
• [31]Steehler MK, Pfisterer MJ, Na H, Hesham HN, Pehlivanova M, Malekzadeh S: Face, content, and construct validity of a low-cost sinus surgery task trainer. Otolaryngol Head Neck Surg 2012, 146:504-509.
• [32]Jensen UJ, Jensen J, Olivecrona GK, Ahlberg G, Tornvall P: Technical skills assessment in a coronary angiography simulator for construct validation. Simul Healthc 2013, 8:324-328.
• [33]Burden C, Preshaw J, White P, Draycott TJ, Grant S, Fox R: Validation of virtual reality simulation for obstetric ultrasonography: a prospective cross-sectional study. Simul Healthc 2012, 7:269-273.
• [34]Plooy AM, Hill A, Horswill MS, Cresp AS, Watson MO, Ooi SY, Riek S, Wallis GM, Burgess-Limerick R, Hewett DG: Construct validation of a physical model colonoscopy simulator. Gastrointest Endosc 2012, 76:144-150.
• [35]Schaefer JJ 3rd: Simulators and difficult airway management skills. Paediatr Anaesth 2004, 14:28-37.
• [36]Philibert I, Friedmann P, Williams WT: New requirements for resident duty hours. JAMA 2002, 288:1112-1114.