Summative assessments are more powerful drivers of student learning than resource intensive teaching formats

BMC Medicine

Sigrid Harendza²  Gerd Hasenfuss¹  Sven Anders³  Jamie Brown⁴  Tobias Raupach¹ 

[1] Department of Cardiology and Pneumology, University Hospital Göttingen, Robert-Koch-Straße 40, Göttingen, D-37075, Germany;Department of Internal Medicine, University Medical Centre Hamburg-Eppendorf, Martinistraße 52, Hamburg, D-20246, Germany;Department of Legal Medicine, University Medical Centre Hamburg-Eppendorf, Butenfeld 34, Hamburg, D-22529, Germany;Health Behaviour Research Centre, University College London, 1-19 Torrington Place, London, WC1E 7HB, UK

关键词: teaching;    medical education;    electrocardiogram;    assessment;   

Others  :  857158
DOI  :  10.1186/1741-7015-11-61

 received in 2012-10-02, accepted in 2013-03-05,  发布年份 2013

【 摘 要 】

Background

Electrocardiogram (ECG) interpretation is a core clinical skill that needs to be acquired during undergraduate medical education. Intensive teaching is generally assumed to produce more favorable learning outcomes, but recent research suggests that examinations are more powerful drivers of student learning than instructional format. This study assessed the differential contribution of teaching format and examination consequences to learning outcome regarding ECG interpretation skills in undergraduate medical students.

Methods

A total of 534 fourth-year medical students participated in a six-group (two sets of three), partially randomized trial. Students received three levels of teaching intensity: self-directed learning (two groups), lectures (two groups) or small-group peer teaching facilitated by more advanced students (two groups). One of the two groups on each level of teaching intensity was assessed in a formative, the other in a summative written ECG examination, which provided a maximum of 1% credit points of the total curriculum. The formative examination provided individual feedback without credit points. Main outcome was the correct identification of ≥3 out of 5 diagnoses in original ECG tracings. Secondary outcome measures were time spent on independent study and use of additional study material.

Results

Compared with formative assessments, summative assessments increased the odds of correctly identifying at least three out of five ECG diagnoses (OR 5.14; 95% CI 3.26 to 8.09), of spending at least 2 h/week extra on ECG self-study (OR 4.02; 95% CI 2.65 to 6.12) and of using additional learning material (OR 2.86; 95% CI 1.92 to 4.24). Lectures and peer teaching were associated with increased learning effort only, but did not augment examination performance.

Conclusions

Medical educators need to be aware of the paramount role of summative assessments in promoting student learning. Consequently, examinations within medical schools need to be closely matched to the desired learning outcomes. Shifting resources from implementing innovative and costly teaching formats to designing more high-quality summative examinations warrants further investigation.

【 授权许可】

   
2013 Raupach et al; licensee BioMed Central Ltd.

【 图 表 】

【 参考文献 】

• [1]Barrows HS, Mitchell DL: An innovative course in undergraduate neuroscience. Experiment in problem-based learning with 'problem boxes'. Br J Med Educ 1975, 9:223-230.
• [2]Topping KJ: The effectiveness of peer tutoring in further and higher education: a typology and review of the literature. Higher Educ 1996, 32:321-345.
• [3]Norman GR, Schmidt HG: The psychological basis of problem-based learning: a review of the evidence. Acad Med 1992, 67:557-565.
• [4]Vernon DT, Blake RL: Does problem-based learning work? A meta-analysis of evaluative research. Acad Med 1993, 68:550-563.
• [5]Tolsgaard MG, Gustafsson A, Rasmussen MB, Hoiby P, Muller CG, Ringsted C: Student teachers can be as good as associate professors in teaching clinical skills. Med Teach 2007, 29:553-557.
• [6]Newble DI, Jaeger K: The effect of assessments and examinations on the learning of medical students. Med Educ 1983, 17:165-171.
• [7]Wood T: Assessment not only drives learning, it may also help learning. Med Educ 2009, 43:5-6.
• [8]Krupat E, Dienstag JL: Commentary: Assessment is an educational tool. Acad Med 2009, 84:548-550.
• [9]van der Vleuten CPM, Schuwirth LW: Assessing professional competence: from methods to programmes. Med Educ 2005, 39:309-317.
• [10]Hudson JN, Bristow DR: Formative assessment can be fun as well as educational. Adv Physiol Educ 2006, 30:33-37.
• [11]Roediger HL 3rd, Karpicke JD: The power of testing memory: basic research and implications for educational practice. Perspect Psychol Sci 2006, 1:181-210.
• [12]Shiomi H, Nakagawa Y, Morimoto T, Furukawa Y, Nakano A, Shirai S, Taniguchi R, Yamaji K, Nagao K, Suyama T, Mitsuoka H, Araki M, Takashima H, Mizoguchi T, Eisawa H, Sugiyama S, Kimura T, CREDO-Kyoto AMI investigators: Association of onset to balloon and door to balloon time with long term clinical outcome in patients with ST elevation acute myocardial infarction having primary percutaneous coronary intervention: observational study. BMJ 2012, 344:e3257.
• [13]Morrison LJ, Brooks S, Sawadsky B, McDonald A, Verbeek PR: Prehospital 12-lead electrocardiography impact on acute myocardial infarction treatment times and mortality: a systematic review. Acad Emerg Med 2006, 13:84-89.
• [14]Brady WJ, Perron AD, Chan T: Electrocardiographic ST-segment elevation: correct identification of acute myocardial infarction (AMI) and non-AMI syndromes by emergency physicians. Acad Emerg Med 2001, 8:349-360.
• [15]Montgomery H, Hunter S, Morris S, Naunton-Morgan R, Marshall RM: Interpretation of electrocardiograms by doctors. BMJ 1994, 309:1551-1552.
• [16]LaPointe NM, Al-Khatib SM, Kramer JM, Califf RM: Knowledge deficits related to the QT interval could affect patient safety. Ann Noninvasive Electrocardiol 2003, 8:157-160.
• [17]Sur DK, Kaye L, Mikus M, Goad J, Morena A: Accuracy of electrocardiogram reading by family practice residents. Fam Med 2000, 32:315-319.
• [18]Ochsmann EB, Zier U, Drexler H, Schmid K: Well prepared for work? Junior doctors' self-assessment after medical education. BMC Med Educ 2011, 11:99. BioMed Central Full Text
• [19]O'Brien KE, Cannarozzi ML, Torre DM, Mechaber AJ, Durning SJ: Training and assessment of ECG interpretation skills: results from the 2005 CDIM survey. Teach Learn Med 2009, 21:111-115.
• [20]Dandavino M, Snell L, Wiseman J: Why medical students should learn how to teach. Med Teach 2007, 29:558-565.
• [21]Raupach T, Hanneforth N, Anders S, Pukrop T, ten Cate ThJO, Harendza S: Impact of teaching and assessment format on electrocardiogram interpretation skills. Med Educ 2010, 44:731-740.
• [22]Fincher RE, Abdulla AM, Sridharan MR, Houghton JL, Henke JS: Computer-assisted learning compared with weekly seminars for teaching fundamental electrocardiography to junior medical students. South Med J 1988, 81:1291-1294.
• [23]Nilsson M, Bolinder G, Held C, Johansson BL, Fors U, Ostergren J: Evaluation of a web-based ECG-interpretation programme for undergraduate medical students. BMC Med Educ 2008, 8:25. BioMed Central Full Text
• [24]Kingston ME: Electrocardiograph course. J Med Educ 1979, 54:107-110.
• [25]Mahler SA, Wolcott CJ, Swoboda TK, Wang H, Arnold TC: Techniques for teaching electrocardiogram interpretation: self-directed learning is less effective than a workshop or lecture. Med Educ 2011, 45:347-353.
• [26]Schuwirth LW, van der Vleuten CP: Changing education, changing assessment, changing research? Med Educ 2004, 38:805-812.
• [27]Miller A, Archer J: Impact of workplace based assessment on doctors' education and performance: a systematic review. BMJ 2010, 341:c5064.
• [28]Thistlethwaite J: More thoughts on 'assessment drives learning'. Med Educ 2006, 40:1149-1150.
• [29]Knowles MS, Holton E, Swanson RA: The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development. 5th edition. Houston, TX: Gulf Pub Co.; 1998.
• [30]Misch DA: Andragogy and medical education: are medical students internally motivated to learn? Adv Health Sci Educ Theory Pract 2002, 7:153-160.
• [31]van der Vleuten CPM: The Assessment of Professional Competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract 1996, 1:41-67.
• [32]Dochy F, Segers M, van den Bossche P, Gijbels D: Effects of problem-based learning: a meta-analysis. Learn Instruct 2003, 13:533-568.