The use of discrete choice experiments to inform health workforce policy: a systematic review

BMC Health Services Research

Kara Hanson¹  Mylene Lagarde¹  Kate L Mandeville¹ 

[1] Department of Global Health and Development, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London WC1H 9SH, UK

关键词: Health professionals;    Health workers;    Human resources for health;    Stated preferences;    Discrete choice experiment;   

Others  :  1126552
DOI  :  10.1186/1472-6963-14-367

 received in 2014-04-08, accepted in 2014-08-18,  发布年份 2014

【 摘 要 】

Background

Discrete choice experiments have become a popular study design to study the labour market preferences of health workers. Discrete choice experiments in health, however, have been criticised for lagging behind best practice and there are specific methodological considerations for those focused on job choices. We performed a systematic review of the application of discrete choice experiments to inform health workforce policy.

Methods

We searched for discrete choice experiments that examined the labour market preferences of health workers, including doctors, nurses, allied health professionals, mid-level and community health workers. We searched Medline, Embase, Global Health, other databases and grey literature repositories with no limits on date or language and contacted 44 experts. Features of choice task and experimental design, conduct and analysis of included studies were assessed against best practice. An assessment of validity was undertaken for all studies, with a comparison of results from those with low risk of bias and a similar objective and context.

Results

Twenty-seven studies were included, with over half set in low- and middle-income countries. There were more studies published in the last four years than the previous ten years. Doctors or medical students were the most studied cadre. Studies frequently pooled results from heterogeneous subgroups or extrapolated these results to the general population. Only one third of studies included an opt-out option, despite all health workers having the option to exit the labour market. Just five studies combined results with cost data to assess the cost effectiveness of various policy options. Comparison of results from similar studies broadly showed the importance of bonus payments and postgraduate training opportunities and the unpopularity of time commitments for the uptake of rural posts.

Conclusions

This is the first systematic review of discrete choice experiments in human resources for health. We identified specific issues relating to this application of which practitioners should be aware to ensure robust results. In particular, there is a need for more defined target populations and increased synthesis with cost data. Research on a wider range of health workers and the generalisability of results would be welcome to better inform policy.

【 授权许可】

   
2014 Mandeville et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]World Health Organization: World Health Report 2006: Working Together for Health. Geneva: World Health Organization; 2006.
• [2]Joint Learning Initiative: Human Resources for Health: Overcoming the Crisis. Washington, D.C: Global Health Initiative Harvard University; 2004.
• [3]Task Force for Scaling Up Education and Training for Health Workers: Scaling Up, Saving Lives. Geneva: Global Health Workforce Alliance; 2008.
• [4]Blaauw D, Erasmus E, Pagaiya N, Tangcharoensathein V, Mullei K, Mudhune S, Goodman C, English M, Lagarde M: Policy interventions that attract nurses to rural areas: a multicountry discrete choice experiment. Bull World Health Organ 2010, 88:350-356.
• [5]Gosden T, Bowler I, Sutton M: How do general practitioners choose their practice? Preferences for practice and job characteristics. J Health Serv Res Pol 2000, 5:208-213.
• [6]Kolstad J: How to make rural jobs more attractive to health workers. Findings from a discrete choice experiment in Tanzania. Health Economics 2010, 20(2):196-211.
• [7]Mills A, Gilson L, Hanson K, Palmer N, Lagarde M: What do we mean by rigorous health-systems research? Lancet 2008, 372(9649):1527-1529.
• [8]Hensher D, Rose J, Greene W: Applied Choice Analysis: A Primer. Cambridge: Cambridge University Press; 2005.
• [9]Louviere J, Hensher D, Swait J: Stated Choice Methods: Analysis and Applications. Cambridge: Cambridge University Press; 2000.
• [10]Ryan M, Gerard K, Amaya-Amaya M: Using Discrete Choice Experiments to Value Health and Health Care. Dordrecht: Springer; 2008.
• [11]Lancaster K: A new approach to consumer theory. J Polit Econ 1966, 74(2):132-157.
• [12]Louviere JJ, Flynn TN, Carson RT: Discrete choice experiments are not conjoint analysis. J Choice Modelling 2010, 3(3):57-72.
• [13]Hensher DA, Rose JM: Choice Modelling: Foundational Contributions. Cheltenham: Edward Elgar; 2011.
• [14]Rose JM, Bliemer MCJ: Stated choice experimental design theory: The who, the what and the why. In Handbook of Choice Modelling. Edited by Hess S, Daly A. Cheltenham: Edward Elgar; 2014:152-177.
• [15]Ryan M, Scott D, Reeves C, Bate A, van Teijlingen E, Russell E, Napper M, Robb C: Eliciting public preferences for healthcare: a systematic review of techniques. Health Technol Assess 2001, 5(5):1-186.
• [16]Hole A: Modelling heterogeneity in patients' preferences for the attributes of a general practitioner appointment. J Health Econ 2007, 27:1078-1094.
• [17]Sculpher M, Bryan S, Fry P, de Winter P, Payne H, Emberton M: Patient preferences for the management of non-metastatic prostate cancer: a discrete chioce experiment. Br Med J 2004, 328:382-384.
• [18]Scalone L, Watson V, Ryan M, Kotsopoulos N, Patel R: Evaluation of patients' preferences for genital herpes treatment. Sex Transm Dis 2011, 38(9):802-807.
• [19]Kruk ME, Paczkowski M, Mbaruku G, Pinho H, Galea S: Women's preferences for place of delivery in rural Tanzania: a population-based discrete choice experiment. Am J Public Health 2009, 99(9):1666-1672.
• [20]Kruk ME, Paczkowski MM, Tegegn A, Tessema F, Hadley C, Asefa M, Galea S: Women's preferences for obstetric care in rural Ethiopia: a population-based discrete choice experiment in a region with low rates of facility delivery. J Epidemiol Community Health 2010, 64(11):984-988.
• [21]Kjaer T, Gyrd-Hansen D: Preference heterogeneity and choice of cardiac rehabilitation programs: results from a discrete choice experiment. Health Policy 2008, 85:124-132.
• [22]Lagarde M, Blaauw D: A review of the application and contribution of discrete choice experiments to inform human resources policy interventions. Hum Resour Health 2009, 7:62. BioMed Central Full Text
• [23]Wordsworth S, Skatun D, Scott A, French F: Preferences for general practice jobs: a survey of principals and sessional GPs. J Gen Pract 2004, 54:740-746.
• [24]Gerard K, Ryan M, Amaya-Amaya M: Introduction. In Using Discrete Choice Experiments to Value Health and Health Care. Edited by Ryan M, Gerard K, Amaya-Amaya M. Dordrecht: Springer; 2008:1-10.
• [25]Prince Mahidol Award Conference Secretariat: Report of the Second Global Forum on Human Resources for Health and Prince Mahidol Award Conference 2011. Bangkok: Prince Mahidol Award; 2011.
• [26]Global Health Workforce Alliance: Human Resources for Health: foundation for Universal Health Coverage and the post-2015 development agenda. Report of the Third Global Forum on Human Resources for Health. Geneva: World Health Organization; 2014.
• [27]CapacityPlus: Retaining Health Workers: a Rapid Methodology to Develop Evidence-Based Incentive Packages. Washington, D.C: CapacityPlus; 2011.
• [28]Ryan M, Kolstad J, Rockers P, Dolea C: How to Conduct a Discrete Choice Experiment for Health Workforce Recruitment and Retention in Remote and Rural Areas: A User Guide with Case Studies. Report Number 74489. Geneva: World Health Organization; 2012.
• [29]Lancsar E, Louviere J: Conducting discrete choice experiments to inform healthcare decision making: a user’s guide. Pharm Econ 2008, 26(8):661-677.
• [30]de Bekker-Grob EW, Ryan M, Gerard K: Discrete choice experiments in healthcare: a review of the literature. Health Econ 2012, 21:145-172.
• [31]Louviere J, Lancsar E: Choice experiments in health: the good, the bad, the ugly and toward a brighter future. Health Econ Policy Law 2009, 4:527-546.
• [32]Bryan S, Dolan P: Discrete choice experiments in health economics: for better or for worse? Eur J Health Econ 2004, 5(3):199-202.
• [33]Wainright D: More 'con' than 'joint': problems with the application of conjoint analysis to participatory healthcare decision making. Crit Public Health 2003, 13:373-380.
• [34]Ryan M, Gerard K: Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Health Econ Health Pol 2003, 2(1):55-64.
• [35]Higgins JPT, Green S (Eds): Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration; 2011. Available from http://www.cochrane-handbook.org webcite
• [36]Jüni P, Witschi A, Bloch R, Egger M: The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis. Journal of the American Medical Association 1999, 282:1054-1060.
• [37]Diamond JJ, Ruth DH, Markham FW, Rabinowitz HK, Rosenthal MP: Specialty selections of Jefferson Medical College students: A conjoint analysis. Eval Health Professions 1994, 17:322-328.
• [38]Humphreys J, Jones M, Jones J, Mara P: Workforce retention in rural and remote Australia: determining the factors that influence length of practice. Med J Aust 2002, 176(10):472-476.
• [39]Brown A, Swinyard W, Ogle J: Women in academic medicine: a report of focus groups and questionnaires, with conjoint analysis. J Womens Health 2003, 12(10):999-1008.
• [40]Thornton J: Physician choice of medical specialty: do economic incentives matter? Appl Econ 2000, 32(11):1419-1428.
• [41]Saether EM: Nurses' labour supply with an endogenous choice of care level and shift type: a nested discrete choice model with nonlinear income. Appl Health Econ Health Pol 2004, 3(4):273-280.
• [42]Günther O, Kuerstein B, Riedel-Heller S, Konig H-H: The role of monetary and nonmonetary incentives on the choice of practice establishment: a stated preference study of young physicians in Germany. Health Serv Res 2010, 45(1):212-229.
• [43]Wang T, Wong B, Huang A, Khatri P, Ng C, Forgie M, Lanphear JH, O'Neill PJ: Factors affecting residency rank-listing: a Maxdiff survey of graduating Canadian medical students. BMC Med Educ 2011, 11:61. BioMed Central Full Text
• [44]Lori JR, Rominski S, Richardson J, Agyei-Baffour P, Kweku NE, Gyakobo M: Factors influencing Ghanaian midwifery students' willingness to work in rural areas: A computerized survey. Int J Nurs Stud 2012, 49:834-841.
• [45]Kruk M, Johnson J, Gyakobo M, Agyie-Baffour P, Asabir K, Kotha S, Kwansah J, Nakua E, Snow R, Dzodzomenyo M: Rural practice preferences among medical students in Ghana: a discrete choice experiment. Bull World Health Organ 2010, 88:333-341.
• [46]Chomitz K, Setiadi G, Azwar A, Ismail N, Widiyarti : What Do Doctors Want? Developing Incentives for Doctors to Serve in Indonesia’s Rural and Remote Areas. In Policy Research Working Paper Series No. 1888. Washington, D.C: World Bank; 1998.
• [47]Scott A: Eliciting GPs' preferences for pecuniary and nonpecuniary job characteristics. J Health Econ 2001, 20:329-347.
• [48]Ubach C, Scott A, French F, Awramenko M, Needham G: What do hospital consultants value about their jobs? A discrete choice experiment. Br Med J 2003, 326:1432.
• [49]Hanson K, Jack W: Incentives could induce Ethiopian doctors and nurses to work in rural settings. Health Aff 2010, 29(8):1452-1460.
• [50]Vujicic M, Shengelia B, Alfano M, Bui Thu H: Physician shortages in rural Vietnam: Using a labor market approach to inform policy. Soc Sci Med 2011, 73:970-977.
• [51]Sivey P, Scott A, Witt J, Joyce C, Humphreys J: Junior doctors’ preferences for specialty choice. J Health Econ 2012, 31:813-823.
• [52]Bundeth S, Neath N, Nonglak P, Sethea S: Understanding rural health service in Cambodia: results of a discrete choice experiment. In Improving Health Sector Performance: Institutions, Motivations and Incentives. Singapore: Institute of Southeast Asian Studies; 2011.
• [53]Lagarde M, Traore O, Juquois M, Lemiere C: Quelles politiques incitatives pour attirer le personnel de santé malien hors de Bamako? Resultats du questionnaire emploi DCE Mali. World Bank: Washington, D.C.; 2011.
• [54]Lagarde M, Pagaiya N, Tangchareonsathien V, Blaauw D: One size does not fit all: investigating doctors' stated preference heterogeneity for job incentives to inform policy in Thailand. Health Econ 2013, 22(12):1452-1469.
• [55]Rao KD, Shroff Z, Ramani S, Khandpur N, Murthy S, Hazarika I, Choksi M, Ryan M, Berman P, Vujicic M: How to Attract Health Workers to Rural Areas? Findings from a Discrete Choice Experiment from India. In Health, Nutrition, and Population (HNP) Discussion Paper. Washington, D.C.: The World Bank; 2012.
• [56]Rockers P, Jaskiewicz W, Wurts L, Kruk ME, Mgomella G, Ntalazi F, Tulenko K: Preferences for working in rural clinics among trainee health professionals in Uganda: a discrete choice experiment. BMC Health Serv Res 2012, 12:212. BioMed Central Full Text
• [57]Miranda JJ, Diez-Canseco F, Lema C, Lescano AG, Lagarde M, Blaauw D, Huicho L: Stated preferences of doctors for choosing a job in rural areas of Peru: a discrete choice experiment. PLoS One 2012, 7(12):e50567.
• [58]Scott A, Witt J, Humphreys J, Joyce C, Kalb G, Jeon S-H, McGrail M: Getting Doctors into the Bush: General Practitioners' Preferences for Rural Location. In Melbourne Institute Working Paper Series. Melbourne: The University of Melbourne; 2012.
• [59]Jaskiewicz W, Phathammavong O, Vangkonevilay P, Paphassarang C, Phachanh IT, Wurts L: Toward Development of a Rural Retention Strategy in Lao People's Democratic Republic: Understanding Health Worker Preferences. CapacityPlus: Washington, D.C.; 2012.
• [60]Song K, Scott A, Sivey P, Meng Q: Improving Chinese primary care providers' recruitment and retention: a discrete choice experiment. Health Policy Plan 2013. doi: 10.1093/heapol/czt1098
• [61]Vujicic M, Alfano M, Shengeliac B, Witter S: Attracting Doctors and Medical Students to Rural Vietnam: Insights from a Discrete Choice Experiment. In Health, Nutrition and Population (HNP) Discussion Paper. Washington, D.C: World Bank; 2010.
• [62]Rockers P, Jaskiewicz W, Kruk M, Phathammavong O, Vanghonevilay P, Paphassarang C, Phachanh IT, Wurts L, Tulenko K: Differences in preferences for rural job postings between nursing students and practicing nurses: evidence from a discrete choice experiment in Lao People’s Democratic Republic. Hum Resour Health 2013, 11:22. BioMed Central Full Text
• [63]Amaya-Amaya M, Gerard K, Ryan M: Discrete choice experiments in a nutshell. In Using Discrete Choice Experiments to Value Health and Health Care. Edited by Ryan M, Gerard K, Amaya-Amaya M. Dordrecht: Springer; 2008.
• [64]Coast J, Horrocks S: Developing attributes and levels for discrete choice experiments using qualitative methods. J Health Serv Res Pol 2007, 12(1):25-30.
• [65]Lagarde M, Blaauw D, Cairns J: Cost-effectiveness analysis of human resources policy interventions to address the shortage of nurses in rural South Africa. Soc Sci Med 2012, 75:801-806.
• [66]McPake B, Maeda A, Araújo EC, Lemiere C, El Maghraby A, Cometto G: Why do health labour market forces matter? Bull World Health Organ 2013, 91:841-846.
• [67]DeShazo J, Fermo G: Designing choice sets for stated preference methods: the effects of complexity on choice consistency. J Environ Econ Manag 2002, 44:123-143.
• [68]Mangham L, Hanson K: Employment preferences of public sector nurses in Malawi: results from a discrete choice experiment. Trop Med Int Health 2008, 13(12):1-9.
• [69]Huicho L, Miranda JJ, Diez-Canseco F, Lema C, Lescano AG, Lagarde M, Blaauw D: Preferences of nurses and midwives for taking up a rural job in Peru: a discrete choice experiment. PLoS One 2012, 7(12):e50315.
• [70]Scott A, Witt J, Humphreys J, Joyce C, Kalb G, Jeon S-H, McGrail M: Getting doctors into the bush: General Practitioners' preferences for rural location. Soc Sci Med 2013, 96:33-44.
• [71]Olsen D, Swait J: Nothing is Important. Working Paper. Alberta: Faculty of Management, University of Calgary; 1997.
• [72]Carson R, Louviere J, Anderson D, Arabie P, Bunch D, Hensher D, Johnson R, Kuhfeld W, Steinberg D, Swait J, Timmermans H, Wiley JB: Experimental analysis of choice. Market Lett 1994, 5(4):351-368.
• [73]King M, Hall J, Lancsar E, Fiebig D, Hossain I, Louviere J, Reddel H, Jenkins C: Patient preferences for managing asthma: results from a discrete choice experiment. Health Econ 2007, 16(7):703-717.
• [74]Ryan M, Skatun D: Modelling non-demanders in choice experiments. Health Econ 2004, 13(4):397-402.
• [75]Kruijshaar M, Essink-Bot M-L, Donkers B, Looman C, Siersema P, Steyerberg E: A labelled discrete choice experiment adds realism to the choices presented: preferences for surveillance tests for Barrett esophagus. BMC Med Res Methodol 2009, 9:31. BioMed Central Full Text
• [76]Scott A, Bond C, Inch J, Grant A: Preferences of community pharmacists for extended roles in primary care: a survey and discrete choice experiment. Pharmacoeconomics 2007, 25:783-792.
• [77]Ageyi-Baffour P, Rominski S, Nakua E, Gyakobo M, Lori JR: Factors that influence midwifery students in Ghana when deciding where to practice: a discrete choice experiment. BMC Med Educ 2013, 13:64. BioMed Central Full Text
• [78]Fiebig DG, Keane MP, Louviere J, Wasi N: The generalized multinomial logit model: accounting for scale and coefficient heterogeneity. Market Sci 2010, 29(3):393-421.
• [79]Lancsar E, Louviere J, Flynn TN: Several methods to investigate relative attribute impact in stated preference experiments. Soc Sci Med 2007, 64:1738-1753.
• [80]Borjas G: Compensating Wage Differentials. In Labor Economics. 5th edition. New York: McGraw-Hill; 2010:205-235.
• [81]Kahneman D, Tversky A: Prospect theory: an analysis of decision under risk. Econometrica 1979, 472:263-291.
• [82]Vujicic M, Alfano M, Ryan M, Sanford Wesse C, Brown-Annan J: Policy Options to Retain Nurses in rural Liberia: Evidence from a Discrete Choice Experiment. Monrovia: Ministry of Health and Social Welfare/World Bank; 2010.
• [83]Rao KD, Ramani S, Murthy S, Hazarika I, Khandpur N, Choksi M, Khanna S, Vujicic M, Berman P, Ryan M: Health Worker Attitudes Toward Rural Service in India: Results from Qualitative Research. In Health, Nutrition and Population (HNP) Discussion Paper. Washington, D.C: World Bank; 2010.
• [84]Serneels P, Lindelow M, Lievens T: Qualitative Research to Prepare Quantitative Analysis: Absenteeism among Health workers in two African countries. In Are You Being Served? New Tools for Measuring Service Delivery. Edited by Amin S, Das J, Goldstein M. Washington, D.C: World Bank; 2008.
• [85]McIntosh E: Using discrete choice experiments within a cost-benefit analysis framework: some considerations. Pharmacoeconomics 2006, 24(9):855-868.
• [86]Adamowicz W, Louviere J, Wiliams M: Combining revealed and stated preference methods for valuing environmental amenities. J Environ Econ Manag 1994, 26(3):271-292.