Comparison of the sensitivity of the UKCAT and A Levels to sociodemographic characteristics: a national study

BMC Medical Education

Sandra Nicholson¹  Lisa Webster²  John C McLachlan³  Paul A Tiffin² 

[1] Institute Health Science Education, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, UK;School for Medicine, Pharmacy and Health, the Wolfson Research Institute, Durham University Queen’s Campus, University Boulevard, Stockton-on-Tees TS17 6BH, UK;School for Medicine, Pharmacy and Health, Durham University Queen’s Campus, University Boulevard, Stockton-on-Tees TS17 6BH, UK

关键词: Socio-economic factors;    UKCAT;    Aptitude tests;    Educational attainment;    Medical student selection;   

Others  :  1135669
DOI  :  10.1186/1472-6920-14-7

 received in 2013-05-20, accepted in 2013-12-30,  发布年份 2014

【 摘 要 】

Background

The UK Clinical Aptitude Test (UKCAT) was introduced to facilitate widening participation in medical and dental education in the UK by providing universities with a continuous variable to aid selection; one that might be less sensitive to the sociodemographic background of candidates compared to traditional measures of educational attainment. Initial research suggested that males, candidates from more advantaged socioeconomic backgrounds and those who attended independent or grammar schools performed better on the test. The introduction of the A* grade at A level permits more detailed analysis of the relationship between UKCAT scores, secondary educational attainment and sociodemographic variables. Thus, our aim was to further assess whether the UKCAT is likely to add incremental value over A level (predicted or actual) attainment in the selection process.

Methods

Data relating to UKCAT and A level performance from 8,180 candidates applying to medicine in 2009 who had complete information relating to six key sociodemographic variables were analysed. A series of regression analyses were conducted in order to evaluate the ability of sociodemographic status to predict performance on two outcome measures: A level ‘best of three’ tariff score; and the UKCAT scores.

Results

In this sample A level attainment was independently and positively predicted by four sociodemographic variables (independent/grammar schooling, White ethnicity, age and professional social class background). These variables also independently and positively predicted UKCAT scores. There was a suggestion that UKCAT scores were less sensitive to educational background compared to A level attainment. In contrast to A level attainment, UKCAT score was independently and positively predicted by having English as a first language and male sex.

Conclusions

Our findings are consistent with a previous report; most of the sociodemographic factors that predict A level attainment also predict UKCAT performance. However, compared to A levels, males and those speaking English as a first language perform better on UKCAT. Our findings suggest that UKCAT scores may be more influenced by sex and less sensitive to school type compared to A levels. These factors must be considered by institutions utilising the UKCAT as a component of the medical and dental school selection process.

【 授权许可】

   
2014 Tiffin et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

【 参考文献 】

• [1]McManus I, Powis D, Wakeford R, Ferguson E, James D, Richards P: Intellectual aptitude tests and A levels for selecting UK school leaver entrants for medical school. BMJ 2005, 331:555-559.
• [2]McGaghie WC: Assessing readiness for medical education: evolution of the medical college admission test. JAMA 2002, 288:1085-1090.
• [3]Coates H: Establishing the criterion validity of the Graduate Medical School Admissions Test (GAMSAT). Med Educ 2008, 42:999-1006.
• [4]Adams J, Dowell J, Greatrix R: Use of UKCAT scores in student selection by UK medical schools, 2006–2010. BMC Med Educ 2011, 11:98. BioMed Central Full Text
• [5]Tiffin PA, Dowell JS, McLachlan JC: Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the use of the UKCAT in the 2009 cohort. BMJ 2012, 344:e1805.
• [6]Schwartz S: Fair admissions to higher education: recommendations for good practice. London: Department for Education and Skills; 2004.
• [7]Wu B: Technical Report UK Clinical Aptitude Test (UKCAT) Consortium. Pearson VUE: Chicago, IL; 2010.
• [8]Zumbo BD: Three generations of DIF analyses: considering where it has been, where it is now, and where it is going. Lang Assess Q 2007, 4(2):223-233.
• [9]Wright SR, Bradley PM: Has the UK clinical aptitude test improved medical student selection? Med Educ 2010, 44:1069-1076.
• [10]James D, Yates J, Nicholson S: Comparison of A level and UKCAT performance in students applying to UK medical and dental schools in 2006: cohort study. BMJ 2010, 340:c478.
• [11]Miller RG Jr: Beyond ANOVA: Basics of Applied Statistics. London: Chapman & Hall; 1997.
• [12]Mathers J, Sitch A, Marsh JL, Parry J: Widening access to medical education for under-represented socioeconomic groups: population based cross sectional analysis of UK data, 2002–6. BMJ 2011, 342:539.
• [13]Office for National Statistics. The National Statistics Socio-Economic Classification (NS-SEC), 2011 http://www.ons.gov.uk/ons/guide-method/classifications/guide-to-classifications/index.html webcite. Date of access 15.10.2013
• [14]Tobin J: Estimation of relationships for limited dependent variables. Econometrica 1958, 26:24-36.
• [15]Smithers A: A-Levels 2012. Centre for Education and Employment Research. Buckingham, UK: University of Buckingham; 2012.
• [16]Borlan S, Chorley M: Female doctors put ‘tremendous burden’ on NHS because they get married, have children and want to work part-time. http://www.dailymail.co.uk/news/article-2336235/Female-doctors-NHS-tremendous-burden-married-children-want-work-time.html webcite
• [17]Davidson JM, Lambert TW, Goldacre MJ: Career pathways and destinations 18 years on among doctors who qualified in the United Kingdom in 1977: postal questionnaire survey. BMJ 1998, 317:1425-1428.
• [18]McKinstry B, Colthart I, Elliott K, Hunter C: The feminization of the medical work force, implications for Scottish primary care: a survey of Scottish general practitioners. BMC Health Serv Res 2006, 6:56.20.
• [19]Yates J, James D: Risk factors at medical school for subsequent professional misconduct: multicentre retrospective case–control study. BMJ 2010, 340:c2040.
• [20]Haq I, Higham J, Morris R, Dacre J: Effect of ethnicity and gender on performance in undergraduate medical examinations. Med Educ 2005, 39:1126-1128.
• [21]Dewhurst NG, McManus C, Mollon J, Dacre JE, Vale AJ: Performance in the MRCP(UK) examination 2003–4: analysis of pass rates of UK graduates in relation to self-declared ethnicity and gender. BMC Med 2007, 5:8. BioMed Central Full Text
• [22]Komaromy M, Grumbach K, Drake M: The role of black and hispanic physicians in providing health care for underserved populations. N Engl J Med 1996, 4:1305-1310.
• [23]The Advisory Board Company http://www.advisory.com/Daily-Briefing/2013/06/28/How-the-affirmative-action-ruling-affects-medical-schools webcite Date of access 15.10.2013
• [24]Rushton JP, Jensen AR: Thirty years of research on race differences in cognitive ability. Psychol Public Policy Law 2005, 11:235-294.
• [25]Kreiter CD: A measurement perspective on affirmative action in U.S. medical education. Med Educ Online 2013, 18:20531.
• [26]Rothman AI, Cusimano M: A comparison of physician examiners’, standardized patients’, and communication experts’ ratings of international medical graduates’ English proficiency. Acad Med 2000, 75:1206-1211.
• [27]Beckmann JF: Superiority: always and everywhere? On some misconceptions in the validation of dynamic testing. Educ Child Psychol 2006, 23:35-49.
• [28]Guthke J, Beckmann JF: The learning test concept and its application in practice. In Dynamic Assessment: Prevailing Models and Applications. Edited by Lidz CS, Elliott JG. Oxford, UK: Elsevier Science; 2000:17-69.