Face and content validity of a novel, web-based otoscopy simulator for medical education

Journal of Otolaryngology-Head & Neck Surgery

Sumit K Agrawal⁴  Hanif M Ladak²  Murad Husein³  David P Morris¹  Jordan Lewis⁵  Brandon Wickens³ 

[1] Division of Otolaryngology – Head and Neck Surgery, Department of Surgery, Dalhousie University, Halifax, Nova Scotia, Canada;Department of Electrical & Computer Engineering, Western University, London, Ontario, Canada;Department of Otolaryngology – Head and Neck Surgery, Western University, London, Ontario, Canada;London Health Sciences Centre, Room B1-333, University Hospital, 339 Windermere Rd., London N6A 5A5, Ontario, Canada;Department of Medical Biophysics, Western University, London, Ontario, Canada

关键词: Evaluation;    Metrics;    Otitis media with effusion;    Otitis media;    Simulator;    Web-based;    Simulation;    Medical education;    Otoscopy;    Otology;   

Others  :  1132923
DOI  :  10.1186/s40463-015-0060-z

 received in 2014-10-21, accepted in 2015-01-26,  发布年份 2015

【 摘 要 】

Background

Despite the fact that otoscopy is a widely used and taught diagnostic tool during medical training, errors in diagnosis are common. Physical otoscopy simulators have high fidelity, but they can be expensive and only a limited number of students can use them at a given time.

Objectives

1) To develop a purely web-based otoscopy simulator that can easily be distributed to students over the internet. 2) To assess face and content validity of the simulator by surveying experts in otoscopy.

Methods

An otoscopy simulator, OtoTrain™, was developed at Western University using web-based programming and Unity 3D. Eleven experts from academic institutions in North America were recruited to test the simulator and respond to an online questionnaire. A 7-point Likert scale was used to answer questions related to face validity (realism of the simulator), content validity (expert evaluation of subject matter and test items), and applicability to medical training.

Results

The mean responses for the face validity, content validity, and applicability to medical training portions of the questionnaire were all ≤3, falling between the “Agree”, “Mostly Agree”, and “Strongly Agree” categories. The responses suggest good face and content validity of the simulator. Open-ended questions revealed that the primary drawbacks of the simulator were the lack of a haptic arm for force feedback, a need for increased focus on pneumatic otoscopy, and few rare disorders shown on otoscopy.

Conclusion

OtoTrain™ is a novel, web-based otoscopy simulator that can be easily distributed and used by students on a variety of platforms. Initial face and content validity was encouraging, and a skills transference study is planned following further modifications and improvements to the simulator.

【 授权许可】

   
2015 Wickens et al.; licensee BioMed Central.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

【 参考文献 】

• [1]Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al.: Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012, 380:2163-96.
• [2]Rovers MM, Schilder AG, Zielhuis GA, Rosenfeld RM: Otitis media. Lancet 2004, 363:465-73.
• [3]Fisher EW, Pfleiderer AG: Assessment of the otoscopic skills of general practitioners and medical students: is there room for improvement? Br J Gen Pract 1992, 42:65-7.
• [4]Pichichero ME: Diagnostic accuracy, tympanocentesis training performance, and antibiotic selection by pediatric residents in management of otitis media. Pediatrics 2002, 110:1064-70.
• [5]Steinbach WJ, Sectish TC, Benjamin DK Jr, Chang KW, Messner AH: Pediatric residents' clinical diagnostic accuracy of otitis media. Pediatrics 2002, 109:993-8.
• [6]Pichichero ME, Poole MD: Assessing diagnostic accuracy and tympanocentesis skills in the management of otitis media. Arch Pediatr Adolesc Med 2001, 155:1137-42.
• [7]Pichichero ME, Poole MD: Comparison of performance by otolaryngologists, pediatricians, and general practioners on an otoendoscopic diagnostic video examination. Int J Pediatr Otorhinolaryngol 2005, 69:361-6.
• [8]Davies J, Djelic L, Campisi P, Forte V, Chiodo A: Otoscopy simulation training in a classroom setting: A novel approach to teaching otoscopy to medical students. Laryngoscope 2014, 124(11):2594-7.
• [9]Morris E, Kesser BW, Peirce-Cottler S, Keeley M: Development and validation of a novel ear simulator to teach pneumatic otoscopy. Simul Healthc 2012, 7:22-6.
• [10]Volsky PG, Hughley BB, Peirce SM, Kesser BW: Construct validity of a simulator for myringotomy with ventilation tube insertion. Otolaryngol Head Neck Surg 2009, 141:603-8. e601
• [11]Cook DA: Learning and cognitive styles in web-based learning: theory, evidence, and application. Acad Med 2005, 80:266-78.
• [12]Cook DA: The research we still are not doing: an agenda for the study of computer-based learning. Acad Med 2005, 80:541-8.
• [13]Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM: Internet-based learning in the health professions: a meta-analysis. JAMA 2008, 300:1181-96.