Grading reflective essays: the reliability of a newly developed tool- GRE-9

BMC Medical Education

Basem R. Saab¹  Diana Rahme¹  Umayya Musharafieh¹  Nisrine N. Makarem¹  Grace Maalouf¹  Fadila Naji¹  Dayana Brome² 

[1] Department of Family Medicine, American University of Beirut-Medical Center;Department of Psychology, Haigazian University;

关键词: Reflective writing;    Reflective articles;    Grading tools;    Reflection;   

DOI  :  10.1186/s12909-020-02213-2

来源: DOAJ

【 摘 要 】

Abstract Background The main objective of this study is the development of a short reliable easy-to-use assessment tool in the aim of providing feedback to the reflective writings of medical students and residents. Methods This study took place in a major tertiary academic medical center in Beirut, Lebanon. Seventy-seven reflective essays written by 18 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 3 raters using the newly developed scale to assess the scale reliability. Following a comprehensive search and analysis of the literature, and based on their experience in reflective grading, the authors developed a concise 9-item scale to grade reflective essays through repeated cycles of development and analysis as well as the determination of the inter-rater reliability (IRR) using intra-class correlation coefficients (ICC) and Krippendorff’s Alpha. Results The inter-rater reliability of the new scale ranges from moderate to substantial with ICC of 0.78, 95% CI 0.64–0.86, p < 0.01 and Krippendorff’s Alpha was 0.49. Conclusions The newly developed scale, GRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial inter-rater reliability. This will enable raters to objectively grade reflective essays and provide informed feedback to residents and students.

【 授权许可】

Unknown