Predictive power of UKCAT and other pre-admission measures for performance in a medical school in Glasgow: a cohort study

BMC Medical Education

Allison Browitt³  Helen Sweeting⁴  John D McClure¹  Nana Sartania² 

[1] Institute of Cardiovascular and Medical Sciences, Glasgow, UK;University of Glasgow School of Medicine, Wolfson Medical School Building, University Avenue, G12 8QQ Glasgow, UK;Recruitment and International Office, University of Glasgow, Glasgow, UK;MRC/CSO Social & Public Health Sciences Unit, Glasgow, UK

关键词: School HE participation rate;    Admissions interview;    Socio-economic indicators;    Widening participation;    Predictive validity;    UKCAT;   

Others  :  866692
DOI  :  10.1186/1472-6920-14-116

 received in 2014-01-17, accepted in 2014-05-06,  发布年份 2014

【 摘 要 】

Background

The UK Clinical Aptitude Test (UKCAT) and its four subtests are currently used by 24 Medical and Dental Schools in the UK for admissions. This longitudinal study examines the predictive validity of UKCAT for final performance in the undergraduate medical degree programme at one Medical School and compares this with the predictive validity of the selection measures available pre-UKCAT.

Methods

This was a retrospective observational study of one cohort of students, admitted to Glasgow Medical School in 2007. We examined the associations which UKCAT scores, school science grades and pre-admissions interview scores had with performance indicators, particularly final composite scores that determine students’ postgraduate training opportunities and overall ranking (Educational Performance Measure - EPM, and Honours and Commendation – H&C). Analyses were conducted both with and without adjustment for potential socio-demographic confounders (gender, age, ethnicity and area deprivation).

Results

Despite its predictive value declining as students progress through the course, UKCAT was associated with the final composite scores. In mutually adjusted analyses (also adjusted for socio-demographic confounders), only UKCAT total showed independent relationships with both EPM (p = 0.005) and H&C (p = 0.004), school science achievements predicted EPM (p = 0.009), and pre-admissions interview score predicted neither. UKCAT showed less socio-demographic variation than did TSS.

Conclusion

UKCAT has a modest predictive power for overall course performance at the University of Glasgow Medical School over and above that of school science achievements or pre-admission interview score and we conclude that UKCAT is the most useful predictor of final ranking.

【 授权许可】

   
2014 Sartania et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]McManus IC, Smithers E, Partridge P, Keeling A, Fleming PR: A levels and intelligence as predictors of medical careers in UK doctors: 20 year prospective study. BMJ 2003, 327:139-142.
• [2]McManus IC, Dewberry C, Nicholson S, Dowell J: The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical school. BMC Med 2013, 11:244. BioMed Central Full Text
• [3]Julian ER: Validity of the Medical College admission test for predicting medical school performance. Acad Med 2005, 80:910-917.
• [4]White CB, Dey EL, Fantone JC: Analysis of factors that predict clinical performance in medical school. Adv Health Sci Educ 2009, 14:455-464.
• [5]Bekhradnia B, Thompson J: Who Does Best at University? 2002. http://webarchive.nationalarchives.gov.uk/20081202000732/http://hefce.ac.uk/Learning/whodoes/ webcite
• [6]Meredith KE, Dunlap MR, Baker HH: Subjective and objective admissions factors as predictors of clinical clerkship performance. J Med Educ 1982, 57:743-751.
• [7]Powis DA, Neame RL, Bristow T, Murphy LB: The objective structured interview for medical student selection. BMJ 1988, 296:765-768.
• [8]Shaw DL, Martz DM, Lancaster CJ, Sade RM: Influence of medical school applicants’ demographic and cognitive characteristics on interviewer’s ratings of non-cognitive traits. Acad Med 1995, 70:532-536.
• [9]Rolfe IE, Powis DA: Selecting Australian doctors of the future. Med J Aust 1997, 166:2129-2230.
• [10]McManus IC, Powis DA, Wakeford R, Ferguson E, James D, Richards P: Intellectual aptitude tests and A levels for selecting UK school leaver entrants for medical school. BMJ 2005, 331:555-559.
• [11]Nicholson S: Commentary: the benefits of aptitude testing for selecting medical students. BMJ 2005, 331:559-560.
• [12]Fernando N, Prescott G, Cleland J, Greaves K, McKenzie H: A comparison of the United Kingdom Clinical Aptitude Test (UKCAT) with a traditional admission selection process. Med Teach 2009, 31:1018-1023.
• [13]Streyfeller L, Altmaier E, Kuperman S, Patrick L: Development of a medical school admissions interview. Adv Health Sci Educ 2004, 9:147-159.
• [14]Goho B, Blackman A: The effectiveness of academic admission interviews: an explanatory meta-analysis. Med Teach 2006, 28:335-340.
• [15]Albanese MA, Snow MH, Skochelak SE, Huggett KN, Farrell PM: Assessing personal qualities in medical school admissions. Acad Med 2003, 78:313-321.
• [16]Edwards JC, Johnston EK, Molidor JB: The interview in the admissions process. Acad Med 1990, 65:167-177.
• [17]Steele K: Selecting tomorrow’s doctors. Ulster Med J 2011, 80:62-67.
• [18]UKCAT 2006 Annual Report http://www.ukcat.ac.uk/App_Media/uploads/pdf/Annual%20Report%202006.pdf webcite
• [19]Cassidy J: UKCAT among the pigeons. BMJ 2008, 336(7646):691-692.
• [20]Tiffin P, Dowell JS, Mclachlan JC: Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort. BMJ 2012, 344:e1805.
• [21]Adam J, Dowell J, Greatrix R: Use of UKCAT scores in student selection by UK medical schools, 2006–2010. BMC Med Educ 2011, 11:98. http://www.biomedcentral.com/1472-6920/11/98/abstract webcite BioMed Central Full Text
• [22]Yates J, James D: The value of the UK clinical aptitude test in predicting preclinical performance: a prospective cohort study at Nottingham Medical School. BMC Med Educ 2010, 10:55. BioMed Central Full Text
• [23]Yates J, James D: The UK clinical aptitude test and clinical course performance at Nottingham: a prospective cohort study. BMC Med Educ 2013, 13:32. BioMed Central Full Text
• [24]Lynch B, Mackenzie R, Dowell J, Cleland J, Prescott G: Does the UKCAT predict Year 1 performance in medical school? Med Educ 2009, 43:1203-1209.
• [25]Wright SR, Bradley PM: Has the UK clinical aptitude test improved medical student selection? Med Educ 2010, 44:1069-1076.
• [26]The Scottish Government: Scottish Index of Multiple Deprivation. 2012. Retrieved June 29, 2013. [http://www.scotland.gov.uk/Topics/Statistics/SIMD webcite]
• [27]HM Government: English Indices of Deprivation 2010. 2010. Retrieved June 29, 2013. [http://data.gov.uk/dataset/index-of-multiple-deprivation webcite]