Guiding Residency Program Educational Goals Using Institutional Keyword Reports from the Ophthalmic Knowledge Assessment Program Examination

Journal of Academic Ophthalmology

article

Isdin Oke¹  Steven D. Ness¹  Jean E. Ramsey¹  Nicole H. Siegel¹  Crandall E. Peeler¹ 

[1] Department of Ophthalmology, Boston Medical Center, Boston University School of Medicine

关键词: Ophthalmic Knowledge Assessment Program;    institution keyword reports;    residency program;    didactics;    education;    curriculum;   

DOI  :  10.1055/s-0040-1718565

学科分类：社会科学、人文和艺术（综合）

来源: Thieme

【 摘 要 】

Introduction Residency programs receive an institutional keyword report following the annual Ophthalmic Knowledge Assessment Program (OKAP) examination containing the raw number of incorrectly answered questions. Programs would benefit from a method to compare relative performance between subspecialty sections. We propose a technique of normalizing the keyword report to determine relative subspecialty strengths and weaknesses in trainee performance.Methods We retrospectively reviewed our institutional keyword reports from 2017 to 2019. We normalized the percentage of correctly answered questions for each postgraduate year (PGY) level by dividing the percent of correctly answered questions for each subspecialty by the percent correct across all subsections for that PGY level. We repeated this calculation for each PGY level in each subsection for each calendar year of analysis.Results There was a statistically significant difference in mean performance between the subspecialty sections (p = 0.038). We found above average performance in the Uveitis and Ocular Inflammation section (95% confidence interval [CI]: 1.02–1.18) and high variability of performance in the Clinical Optics section (95% CI: 0.76–1.34).Discussion The OKAP institutional keyword reports are extremely valuable for residency program self-evaluation. Performance normalized for PGY level and test year can reveal insightful trends into the relative strengths and weaknesses of trainee knowledge and guide data-driven curriculum improvement.

【 授权许可】

CC BY|CC BY-NC-ND