Development and validation of clinical performance assessment in simulated medical emergencies: an observational study

BMC Emergency Medicine

Research Article

Aysen Erdogan¹  Brian Pickering²  Xiaomei Chen³  Rahul Kashyap⁴  Yue Dong⁴  Ronaldo A. Sevilla Berrios⁴  Lisbeth Y. Garcia Arguello⁴  Ognjen Gajic⁴  John C. O’Horo⁴  Oguz Kilickaya⁵  Christopher Schmickl⁶ 

[1] Department of Medicine, Mayo Clinic, Rochester, MN, USA;Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA;Department of Anesthesiology and Reanimation, Suleyman Demirel University, Isparta, Turkey;METRIC group, Mayo Clinic, Rochester, MN, USA;Department of Medicine, Mayo Clinic, Rochester, MN, USA;Department of Anesthesiology, Mayo Clinic, Rochester, MN, USA;METRIC group, Mayo Clinic, Rochester, MN, USA;Department of Medicine, Mayo Clinic, Rochester, MN, USA;Department of Critical Care Medicine, Qilu Hospital of Shandong University, Shandong, China;Department of Medicine, Mayo Clinic, Rochester, MN, USA;METRIC group, Mayo Clinic, Rochester, MN, USA;Department of Medicine, Mayo Clinic, Rochester, MN, USA;METRIC group, Mayo Clinic, Rochester, MN, USA;Department of Anesthesiology and Reanimation, Gulhane Medical Faculty, Ankara, Turkey;Department of Medicine, Mayo Clinic, Rochester, MN, USA;METRIC group, Mayo Clinic, Rochester, MN, USA;Department of Internal Medicine, Boston University Medical Center, Boston, MA, USA;

关键词: Critical Care;    Clinical Decision Support;    Fluid Bolus;    Simulation Center;    Crew Resource Management;   

DOI  :  10.1186/s12873-015-0066-x

 received in 2014-10-31, accepted in 2015-12-07,  发布年份 2016

来源: Springer

【 摘 要 】

BackgroundCritical illness is a time-sensitive process which requires practitioners to process vast quantities of data and make decisions rapidly. We have developed a tool, the Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN), aimed at enhancing care delivery in such situations. To determine the efficacy of CERTAIN and similar cognitive aids, we developed rubric for evaluating provider performance in a simulated medical resuscitation environments.MethodsWe recruited 18 clinicians with current valid ACLS certification for evaluation in three simulated medical scenarios designed to mimic typical medical decompensation events routinely experienced in clinical care. Subjects were stratified as experienced or novice based on prior critical care training. A checklist of critical actions was designed using face validity for each scenario to evaluate task completion and performance. Simulation sessions were video recorded and scored by two independent raters. Construct validity was assessed under the assumption that experienced clinicians should perform better than novice clinicians on each task. Reliability was assessed as percentage agreement, kappa statistics and Bland-Altman plots as appropriate.ResultsEleven experts and seven novices completed evaluation. The overall agreement on common checklist item completion was 84.8 %. The overall model achieved face validity and was consistent with our construct, with experienced clinicians trending towards better performance compared to novices for accuracy and speed of task completion.ConclusionsA standardized video assessment tool has potential to provide a valid and reliable method to assess 12 performances of clinicians facing simulated medical emergencies.

【 授权许可】

CC BY   
© Erdogan et al. 2016