Grading reflective essays: the reliability of a newly developed tool- GRE-9

BMC Medical Education

Umayya Musharafieh¹  Grace Maalouf¹  Fadila Naji¹  Basem R. Saab¹  Diana Rahme¹  Nisrine N. Makarem¹  Dayana Brome² 

[1] Department of Family Medicine, American University of Beirut-Medical Center, P. O Box 11-0236, Riad El-Solh, 1107 2020, Beirut, Lebanon;Department of Psychology, Haigazian University, P.O.Box: 11-1748, Rue Mexique, Kantari, Riad el Solh, 11072090, Beirut, Lebanon;

关键词: Reflective writing;    Reflective articles;    Grading tools;    Reflection;   

DOI  :  10.1186/s12909-020-02213-2

来源: Springer

【 摘 要 】

BackgroundThe main objective of this study is the development of a short reliable easy-to-use assessment tool in the aim of providing feedback to the reflective writings of medical students and residents.MethodsThis study took place in a major tertiary academic medical center in Beirut, Lebanon. Seventy-seven reflective essays written by 18 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 3 raters using the newly developed scale to assess the scale reliability. Following a comprehensive search and analysis of the literature, and based on their experience in reflective grading, the authors developed a concise 9-item scale to grade reflective essays through repeated cycles of development and analysis as well as the determination of the inter-rater reliability (IRR) using intra-class correlation coefficients (ICC) and Krippendorff’s Alpha.ResultsThe inter-rater reliability of the new scale ranges from moderate to substantial with ICC of 0.78, 95% CI 0.64–0.86, p < 0.01 and Krippendorff’s Alpha was 0.49.ConclusionsThe newly developed scale, GRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial inter-rater reliability. This will enable raters to objectively grade reflective essays and provide informed feedback to residents and students.

【 授权许可】

CC BY