A new tool to evaluate postgraduate training posts: the Job Evaluation Survey Tool (JEST)

BMC Medical Education

Jonathan Howes¹  Elizabeth Hughes¹  Andrew Whitehouse¹  Baldev Singh¹  Helen Goodyear¹  David Wall¹ 

[1] Health Education West Midlands, St Chad’s Court, 213 Hagley Road, Birmingham B16 9RG, UK

关键词: Training posts;    Quality assurance;    Quality management;    Evaluation of training;   

Others  :  1090852
DOI  :  10.1186/1472-6920-14-210

 received in 2014-01-18, accepted in 2014-08-15,  发布年份 2014

【 摘 要 】

Background

Three reports in 2013 about healthcare and patient safety in the UK, namely Berwick, Francis and Keogh have highlighted the need for junior doctors’ views about their training experience to be heard. In the UK, the General Medical Council (GMC) quality assures medical training programmes and requires postgraduate deaneries to undertake quality management and monitoring of all training posts in their area. The aim of this study was to develop a simple trainee questionnaire for evaluation of postgraduate training posts based on the GMC, UK standards and to look at the reliability and validity including comparison with a well-established and internationally validated tool, the Postgraduate Hospital Educational Environment Measure (PHEEM).

Methods

The Job Evaluation Survey Tool (JEST), a fifteen item job evaluation questionnaire was drawn up in 2006, piloted with Foundation doctors (2007), field tested with specialist paediatric registrars (2008) and used over a three year period (2008–11) by Foundation Doctors. Statistical analyses including descriptives, reliability, correlation and factor analysis were undertaken and JEST compared with PHEEM.

Results

The JEST had a reliability of 0.91 in the pilot study of 76 Foundation doctors, 0.88 in field testing of 173 Paediatric specialist registrars and 0.91 in three years of general use in foundation training with 3367 doctors completing JEST. Correlation of JEST with PHEEM was 0.80 (p < 0.001). Factor analysis showed two factors, a teaching factor and a social and lifestyle one.

Conclusion

The JEST has proved to be a simple, valid and reliable evaluation tool in the monitoring and evaluation of postgraduate hospital training posts.

【 授权许可】

   
2014 Wall et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

【 参考文献 】

• [1]Francis R: Report of the Mid Staffordshire NHS Foundation Trust public inquiry. 2013. http://www.official-documents.gov.uk/document/hc1213/hc09/0947/0947.pdf webcite
• [2]Keogh B: Review into the quality of care and treatment provided by 14 hospital trusts in England: an overview report. 2013. http://www.nhs.uk/NHSEngland/bruce-keogh-review/Documents/outcomes/keogh-review-final-report.pdf webcite
• [3]National Advisory Group on the Safety of Patients in England: A promise to learn – a commitment to act: Improving the safety of patients in England. 2013. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/226703/Berwick_Report.pdf webcite
• [4]Winthrop C, Wilkinson I, George J: The Francis and Keogh reviews have made junior doctors powerful agents for change. BMJ Careers 2013. http://careers.bmj.com/careers/advice/view-article.html?id=20015202 webcite
• [5]Da Dalt L, Callegaro S, Mazzi A, Scipioni A, Lago P, Chiozza ML, Zacchello F, Perilongo G: A model of quality assurance and quality improvement for post-graduate medical education in Europe. Med Teach 2010, 32:e57-e64.
• [6]World Federation for Medical Education: Postgraduate Medical Education: University of Copenhagen, Denmark: WFME Office. University of Copenhagen, Denmark: WFME Office; 2003. http://www.eua.be/fileadmin/user_upload/files/newsletter/EUROPEAN-SPECIFICATIONS-WFME-GLOBAL-STANDARDS-MEDICAL_EDUCATION.pdf webcite
• [7]ACGME: ACGME Residents Survey Content Areas 2012–2013. http://www.acgme.org/acgmeweb/Portals/0/ResidentSurvey_ContentAreas.pdf webcite
• [8]Maniate JM: The Accreditation Process: Ensuring quality Postgraduate Medical Education in Canada. A Manual for Residents. 2nd edition. Ottawa: Canadian Association of Internes and Residents (CAIR); 2012. http://www.cair.ca/u/elibrary/The%20Accreditation%20Process%202nd%20edition.pdf webcite
• [9]Genn JM: AMEE Medical Education Guide No. 23 (Part 2): Curriculum, environment, climate, quality and change in medical education -a unifying perspective. Med Teach 2001, 23:445-454.
• [10]Roff S, McAleer S, Skinner A: Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach 2005, 27:326-331.
• [11]Boor K, Van der Vleuten C, Teunissen P, Scherpbier A, Scheele F: Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach 2011, 33:820-827.
• [12]Mohanna K, Wall D, Chambers R: Teaching Made Easy – a manual for health professionals. 2nd edition. Oxford: Radcliffe Medical Press; 2004.
• [13]Wall D: Evaluation: improving practice, influencing policy. In Understanding Medical education Evidence, theory and practice. Edited by Swanwick T. Chichester: Wiley Blackwell and The Association for Medical Education; 2010:336-351.
• [14]General Medical Council: Quality Improvement Framework for Undergraduate and Postgraduate Medical Education and Training in the UK. London: General Medical Council; 2010. http://www.gmc-uk.org/Quality_Improvement_Framework.pdf_39623044.pdf webcite
• [15]Wall D, Whitehouse A, Campbell I, Kelly S, Cook S: Computerised evaluations of their education and training by senior house officers in the West Midlands. Hosp Med 2000, 61:54-56.
• [16]Wall DW, Woodward D, Whitehouse A, Kelly S, O'Regan C, Dykes P, Cook S: The development and uses of a computerised evaluation tool for SHO posts in the West Midlands Region. Med Teach 2001, 23:24-28.
• [17]General Medical Council: GMC Education Strategy 2011–2013. Shaping the future of medical education and training. London: General Medical Council; 2010. http://www.gmc-uk.org/Education_Strategy_2011_2013.pdf_36672939.pdf webcite
• [18]General Medical Council: The Trainee Doctor. London: GMC; 2011.
• [19]Dent JA, Harden RM: A Practical Guide for Medical Teachers. 2nd edition. Edinburgh: Elsevier Churchill Livingstone; 2005.
• [20]Field A: Discovering statistics using SPSS for Windows. 2nd edition. London: Sage Publications Limited; 2004.
• [21]Streiner D, Norman G: Health Measurement Scales: A practical guide to their development and use. 3rd edition. Oxford: Oxford University Press; 2003.
• [22]Brennan RL: Generalizability Theory. New York: Springer; 2001.
• [23]PMETB: National Trainee Survey 2006 – Key Findings. Postgraduate Medical Education and Training Board. 2007. [http://www.gmc-uk.org/NationalSurveyofTraineeDoctors2006.pdf_30531088.pdf webcite]
• [24]Jones ML, Hobson RS, Plasschaert AJM, Gundersen S, Dummer P, Roger-Leroi V, Sidlauskas A, Hamlin J: Quality assurance and benchmarking: an approach for European dental schools. Eur J Dent Educ 2007, 11:137-143.