A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment

BMC Medical Education

Benedicte Y De Winter⁵  Leo L Bossaert⁶  Luc F Van Gaal¹  Erik W Driessen²  Joke Denekens³  Nele RM Michels⁴ 

[1] Department of Diabetology, Metabolism and Clinical Nutrition, Antwerp University Hospital, Wilrijkstraat 10, Antwerp 2650, Belgium;Department of Educational Development and Research, Faculty of Health, Medicine and Life Sciences, Maastricht University, PO Box 616, Maastricht 6200MD, The Netherlands;Educational Department and Faculty of Medicine and Health Sciences, University of Antwerp, Middelheimcampus – M.A.211 – Middelheimlaan 1, Antwerp 2020, Belgium;Skills Lab, Faculty of Medicine and Health Sciences, University of Antwerp, Campus Drie Eiken – D.R.314 – Universiteitsplein 1, Antwerp 2610, Belgium;Skills Lab, Faculty of Medicine and Health Sciences, University of Antwerp, Campus Drie Eiken, D.T.226 – Universiteitsplein 1, Antwerp 2610, Belgium;Faculty of Medicine and Health Sciences, University of Antwerp, Campus Drie Eiken, D.S.034 – Universiteitsplein 1, Antwerp 2610, Belgium

关键词: Competence inventory;    Delphi study;    Workplace assessment;    CanMEDS competences;    CanMEDS roles;    Content validity;    Medical education;    Portfolio;   

Others  :  1153374
DOI  :  10.1186/1472-6920-12-86

 received in 2012-02-10, accepted in 2012-09-06,  发布年份 2012

【 摘 要 】

Background

During workplace based learning students develop professional competences and an appropriate performance. To gain insight in the learning process and to evaluate competences and performance, assessment tools are essential and need to be of good quality. We aimed to construct a competence inventory applicable as an instrument to measure the content validity of workplace based assessment tools, such as portfolio.

Methods

A Delphi study was carried out based on the CanMEDS Roles Framework. In three rounds, experts (N = 25–30) were invited to score the key competences per CanMEDS role on relevance (6-point Likert-scale), and to comment on the content and formulation bearing in mind its use in workplace based assessment. A descriptive analysis of relevances and comments was performed.

Results

Although all competences were scored as relevant, many comments pointed at a lack of concrete, transparent and applicable descriptions of the key competences for the purpose of assessment. Therefore, the CanMEDS roles were reformulated in this Delphi procedure as concrete learning outcomes, observable and suitable for workplace based assessment.

Conclusions

A competence based inventory, ready for validating workplace based assessment tools, was constructed using a Delphi procedure and based on a clarification and concretisation of the CanMEDS roles.

【 授权许可】

   
2012 Michels et al; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]Frank JR, Danoff D: The CanMEDS initiative: implementing an outcomes-based framework of physician competences. Medical Teacher 2007, 29(7):642-647.
• [2]Swing SR: The ACGME outcome project: retrospective and prospective. Medical Teacher 2007, 29(7):648-654.
• [3]Tomorrow’s Doctors. London: General Medical Council. Available at: http://www.gmc-uk.org/static/documents/content/GMC_TD_09__1.11.11.pdf webcite
• [4]Rethans JJ, Norcini JJ, Barón-Maldonado M, Blackmore D, Jolly BC, LaDuca T, Lew S, Page GG, Southgate LH: The relationship between competence and performance: implications for assessing practice performance. Medical Education 2002, 36(10):901-909.
• [5]Schuwirth LW, Southgate L, Page GG, Paget NS, Lescop JM, Lew SR, Wade WB, Barón-Maldonado M: When enough is enough: a conceptual basis for fair and defensible practice performance assessment. Medical Education 2002, 36(10):925-930.
• [6]Epstein RM: Assessment in Medical Education. N Engl J Med 2007, 356(4):387-396.
• [7]Norcini JJ: Current perspectives in assessment: the assessment of performance at work. Medical Education 2005, 39(9):880-889.
• [8]Norcini JJ, McKinley DW: Assessment methods in medical education. Teach Teach Educ 2007, 23(3):239-250.
• [9]Schuwirth L, van der Vleuten C: Merging views on assessment. Medical Education 2004, 38(12):1208-1210.
• [10]Driessen E, van der Vleuten C, Schuwirth L, van Tartwijk J, Vermunt J: The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study. Medical Education 2005, 39(2):214-220.
• [11]Royal College of General Practitioners: Portfolio-based Learning in General Practice: Report of a Working Group on Higher Professional Education: December 1993, Occasional paper. 1993:63
• [12]Snadden D, Thomas M: The use of portfolio learning in medical education. Medical Teacher 1998, 20(3):192-199.
• [13]Miller GE: The assessment of clinical skills/competence/performance. Acad Med 1990, 65(suppl 9):63-67.
• [14]Driessen E, van Tartwijk J, van der Vleuten C, Wass V: Portfolios in medical education: why do they meet with mixed success? A systematic review. Medical Education 2007, 41(12):1224-1233.
• [15]Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C, et al.: The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Medical Teacher 2009, 4:282-298.
• [16]Tochel C, Haig A, Hesketh A, Cadzow A, Beggs K, Colthart I, Peacock H: The effectiveness of portfolios for post-graduate assessment and education: BEME Guide No 12. Medical Teacher 2009, 31(4):299-318.
• [17]Ringsted C, Hansen TL, Davis D, Scherpbier A: Are some of the challenging aspects of the CanMEDS roles valid outside Canada? Medical Education 2006, 40(8):807-815.
• [18]The Delphi Method: an experimental study of group opinion. http://www.rand.org/content/dam/rand/pubs/research_memoranda/2005/RM5888.pdf webcite
• [19]The Delphi Method: Techniques and Applications. http://www.is.njit.edu/pubs/delphibook/ webcite
• [20]Michels NR, Driessen EW, Muijtjens AM, Van Gaal LF, Bossaert LL, De Winter BY: Portfolio assessment during medical internships: How to obtain a reliable and feasible assessment procedure? Educ Heal 2009, 22(3):313.
• [21]Michels NR, Van Gaal LF, Bossaert LL, De Winter BY: Portfolio in medisch onderwijs: implementatie in het stagejaar. Tijdschrift voor Geneeskunde 2010, 66(8):386-393.
• [22]Bossaert L, voor het Vlaamse Bolognapromotorenteam: De Vlaamse opleiding tot arts en het Bolognaproces. Naar gemeenschappelijke leerresultaten en competenties. Tijdschrift voor Geneeskunde 2008, 64(13):661-668.
• [23]Braun V, Clarke V: Using thematic analysis in psychology. Qual Res Psychol 2006, 3:77-101.
• [24]CanMEDS 2000: Extract from the CanMEDS 2000 Project Societal Needs Working Group Report. Medical Teacher 2000, 22(6):549-554.
• [25]Rademakers JJ, De Rooy N, Ten Cate OT: Senior medical students’ appraisal of CanMEDS competences. Medical Education 2007, 41(10):990-994.
• [26]Jarvis RM, O’Sullivan PS, McClain T, Clardy JA: Can one portfolio measure the six ACGME general competences? Acad Psychiatry 2004, 28(3):190-196.
• [27]Chou S, Cole G, McLaughlin K, Lockyer J: CanMEDS evaluation in Canadian postgraduate training programmes: tools used and programme director satisfaction. Medical Education 2008, 42(9):879-886.
• [28]Crebbin W: What do you mean by “satisfactory”? Annals of Medicine Singapore 2005, 34(8):473-477.
• [29]Fastré GMJ, van der Klink MR, van Merriënboer JJG: The effects of performance-based assessment criteria on student performance and self-assessment skills. Adv Heal Sci Educ 2010, 15:517-532.
• [30]Huddle TS, Heudebert GR: Taking apart the art: the risk of anatomizing clinical competence. Acad Med 2007, 82(6):536-541.
• [31]Lurie SJ, Mooney CJ, Lyness JM: Measurement of the general competences of the Accreditation Council for Graduate Medical Education: a systematic review. Acad Med 2009, 84(3):301-309.