Cost-effectiveness analyses of training: a manager’s guide

Human Resources for Health

Marcia R Weaver²  Elliot Marseille¹  Gabrielle O’Malley² 

[1] Health Strategies International, 555 59th Street, Oakland, CA, 94609, USA;Department of Global Health, International Training and Education Center for Health, University of Washington, 901 Boren, Suite 1100, Seattle, WA, USA

关键词: Training effectiveness;    Training evaluation;    Cost-effectiveness analysis;    Cost-analysis;    Capacity development;   

Others  :  822531
DOI  :  10.1186/1478-4491-11-20

 received in 2012-07-28, accepted in 2013-04-19,  发布年份 2013

【 摘 要 】

The evidence on the cost and cost-effectiveness of global training programs is sparse. This manager’s guide to cost-effectiveness analysis (CEA) is for professionals who want to recognize and support high quality CEA. It focuses on CEA of training in the context of program implementation or rapid program expansion. Cost analysis provides cost per output and CEA provides cost per outcome. The distinction between these two analyses is essential for making good decisions about value. A hypothetical example of a cost analysis compares the cost per trainee of a computer-based anti-retroviral therapy (ART) training to a more intensive ART training. In a CEA of the same example, cost per trainee who met ART clinical performance standards is compared. The cost analysis is misleading when the effectiveness differs across trainings. Two additional hypothetical examples progress from simple to more complex costs and from a narrow to a broader scope: 1) CEA of the cost per ART patient with 95% adherence that compares the performance of doctors to counselors who attend additional training, and 2) CEA of the cost per infant HIV infection averted for a Prevention of Mother to Child Transmission program that compares the current program to one with additional training. To create an evidence base on CEA of training, more well-designed analyses and data on the cost of training are needed. Analysts should understand more about how capacity is built, how quality is improved within a health facility, and the costs associated with them. Considering the life of an investment in training, evaluations are needed on how many trainees apply the skills taught, how long trainees continue to apply them, and how long the content of the training conforms to national or international guidelines. Better data on effectiveness of training is also needed. It is feasible to measure effectiveness by clinical performance standards, or intermediate outcomes and coverage. Intermediate outcomes and coverage can also be combined with published estimates on health outcomes.

【 授权许可】

   
2013 O’Malley et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Joint United Nations Program on HIV/AIDS (UNAIDS), Global Report: UNAIDS Report on the Global AIDS Epidemic, 2012. Available online at: http://www.unaids.org/en/media/unaids/contentassets/documents/epidemiology/2012/gr2012/20121120_UNAIDS_Global_Report_2012_en.pdf webcite. Accessed on May 28, 2013
• [2]Kendall AE: U.S. Response to the Global Threat ofHIV/AIDS. Basic Facts. Congressional Research Service Repor; 2012. http://www.fas.org/sgp/crs/misc/R41645.pdf webcite
• [3]The United States President’s Emergency Plan for AIDS Relief Capacity-building results; [http://www.pepfar.gov/press/sixth_annual_report/137144.htm webcite]
• [4]Kinfu Y, Dal Poz MR, Mercer H, Evans D: The Health worker shortage in Africa: are enough physicians and nurses being trained? Bull WHO 2009, 87:225-230.
• [5]The United States Government Global Health Strategyhttp://www.ghi.gov/resources/strategies/159150.htm webcite. Accessed on May 28, 2013
• [6]Evans D, Tan-Torres Edejer T, Adam T, Lim S: WHO Choosing Interventions that are Cost Effective (CHOICE) Millennium Development Goals Team. Achieving the millennium development goals for health: Methods to assess the costs and health effects of interventions for improving health in developing countries. BMJ 2005, 331:1137-1140.
• [7]Brown CA, Belfield CR, Field SJ: Cost effectiveness of continuing professional development in health care: a critical review of the evidence. BMJ 2002, 324:652-655.
• [8]McCarthy E, O’Brien M, Rodriguez W: Training and HIV-treatment scale-up: establishing an implementation research agenda. PLoS Med 2006, 3:e304.
• [9]Becker G: Human Capital. Chicago: University of Chicago Press; 1993.
• [10]Walker D, McDermott JM, Fox-Rushby J, Tanjung M, Nadjib M, Widiatmoko D, Achadi E: An economic analysis of midwifery training programmes in South Kalimantan, Indonesia. Bull World Health Organ 2002, 80:47-55.
• [11]Harlow KC, Sportsman S: An economic analysis of patient simulators clinical training in nursing education. Nurs Econ 2007, 25:24-29.
• [12]Arreola-Risa C, Mock C, Herrera-Escamilla AJ, Contreras I, Vargas J: Cost-effectiveness and benefit of alternatives to improve training for prehospital trauma care in Mexico. Prehosp Disaster Med 2004, 19:318-325.
• [13]Fairall L, Bachmann MO, Zwarenstein M, Bateman ED, Niessen LW, Lombard C, Majara B, English R, Bheekie A, van Rensburg D, et al.: Cost-effectiveness of educational outreach to primary care nurses to increase tuberculosis case detection and improve respiratory care: economic evaluation alongside a randomised trial. Trop Med Int Health 2010, 15:277-286.
• [14]Hounton SH, Newlands D, Meda N, De Brouwere V: A cost-effectiveness study of caesarean-section deliveries by clinical officers, general practitioners and obstetricians in Burkina Faso. Human Resources for Health 2009, 7:34.
• [15]Clark KA, Mitchell EH, Aboagye PK: Return on investment for essential obstetric care training in Ghana: do trained public sector midwives deliver postabortion care? J Midwifery Womens Health 2010, 55:153-161.
• [16]Reynolds HW, Toroitich-Ruto C, Nasution M, Beaston-Blaakman A, Janowitz B: Effectiveness of training supervisors to improve reproductive health quality of care: a cluster-randomized trial in Kenya. Health Policy Plan 2008, 23:56-66.
• [17]Goodman CA, Mutemi WM, Baya EK, Willetts A, Marsh V: The cost-effectiveness of improving malaria home management: shopkeeper training in rural Kenya. Health Policy Plan 2006, 21:275-288.
• [18]Sanders J: A family medicine training program in the Republic of Georgia: incorporating a model of chronic disease management. J Am Board Fam Med 2007, 20:557-564.
• [19]Adam T, Manzi F: Armstrong Schellenberg J, Mgalula L, de Savigny D, Evans DB: Does the integrated management of childhood illness cost more than routine care? Results from the United Republic of Tanzania. Bull World Health Organ 2005, 83:369-377.
• [20]Armstrong Schellenberg JRM, Adam T, Mshinda H, Masanja H, Kabadi G, Mukasa O, Theopista J, Sosthenes C, Nathan R, Wilczynska K, et al.: Effectiveness and cost of facility-based Integrated Management of Childhood Illness (IMCI) in Tanzania. Lancet 2004, 364:1583-1594.
• [21]Harrison A, Karim SA, Floyd K, Lombard C, Lurie M, Ntuli N, Wilkinson D: Syndrome packets and health worker training improve sexually transmitted disease case management in rural South Africa: randomized controlled trial. AIDS 2000, 14:2769-2779.
• [22]Gold M, Siegel J, Russell L, Weinstein M: (Eds): Cost–Effectiveness in Health and Medicine. Oxford: Oxford University Press; 1996.
• [23]Siegel J, Weinstein M, Russell L, Gold M: Panel on cost-effectiveness in health and medicine: recommendations for reporting cost-effectiveness analyses. JAMA 1996, 276:1339-1341.
• [24]Weinstein M, Siegel J, Gold M, Kamlet M, Russell L: Recommendations of the panel on cost-effectiveness in health and medicine. JAMA 1996, 276:1253-1258.
• [25]Russell L, Gold M, Siegel J, Daniels N, Weinstein M: The role of cost-effectiveness analysis in health and medicine. Panel on cost-effectiveness in Health and Medicine. JAMA 1996, 276:1172-1177.
• [26]Health Economics Information Resources: A Self-Study Course. http://www.nlm.nih.gov/nichsr/edu/healthecon/index.html webcite
• [27]Drummond M, Sculpher M, Torrance G, O’Brien B: Methods for the Economic Evaluation of Health Care Programmes. 3rd edition. Oxford: Oxford University Press; 2005.
• [28]Joint United Nations Programme on HIV/AIDS: Costing Guidelines for HIV Prevention Strategies. Geneva, Switzerland; 2000. Available online at http://data.unaids.org/Publications/IRC-pub05/JC412-CostGuidel_en.pdf webcite
• [29]Gold M, Stevenson D, Fryback D: HALYS and QALYS and DALYS, OH MY: similarities and differences in summary measures of population health. Annu Rev Public Health 2002, 23:115-134.
• [30]Hammer S, Squires K, Hughs M, Grimes J, Demeter L, Currier J, Eron J, Feinburg J, Balfour H, Dayton L, et al.: AIDS clinical trials group 320 study team: a controlled trial of two nucleoside analogues plus indinavir in person with human immunodeficiency virus infection and CD4 cell counts of 200 per cubic millimeter or less. New England J Med 1997, 337:725-733.
• [31]Montaner J, Reiss P, Cooper D, Vella S, Harris M, Conway B, Wainberg M, Smith D, Robinson P, Hall D: INCAS study group: A randomized, double-blind trial comparing combinations of nevirapine, didanosine, and zidovudine for HIV-infected patients: the INCAS Trial: Italy, the Netherlands, Canada and Australia study. JAMA 1998, 279:930-937.
• [32]Palella F, Delaney K, Moorman A, Loveless M, Fuhrer J, Satten G, Aschman D, Holmberg S, et al.: Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. New England J Med 1998, 338:853-860.
• [33]The Antiretroviral Therapy in Lower Income Countries (ART-LINC) Collaboration and ART Cohort Collaboration (ART-CC) groups: Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet 2006, 367:817-824.
• [34]Lucas G: Antiretroviral adherence, drug resistance, viral fitness and HIV disease progression: a tangled web is woven. J Antimicrob Chemother 2005, 55:413-416.
• [35]Liu H: Mille rL, Hays R, Golin C, Wu T, Wenger N, Kaplan A: Repeated measures longitudinal analyses of HIV virologic response as a function of percent adherence, dose timing, genotypic sensitivity, and other factors. J Acquir Immune Defic Syndr 2006, 41:315-322.
• [36]Chen L, Hoy J, Lewin S: Ten years of highly active antiretroviral therapy for HIV infection. Medical Journal of Australia 2007, 186:146-151.
• [37]Bangsberg D, Hecht F, Charlebois E, Zolopa A, Holodniy M, Sheiner L, Bamberger J, Chesney M, Moss A: Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS 2000, 14:357-366.
• [38]Paterson D, Swindells S, Mohr J, Brester M, Vergis E, Squier C, Wagener M, Singh N: Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med 2000, 133:21-30.
• [39]Hiner C, Mandel B, Weaver M, Bruce D, Lee P, McGaw B, McLaughlin R, Anderson J: Evaluation of a voluntary counseling and testing training program in the Caribbean region. Hum Resour Heal 2009, 7:11.
• [40]Namagembi A, Ssekabira U, Weaver M, Blum N, Burnett S, Dorsey G, et al.: Mpanga Sebuyira L, Ojaku A, Schneider G, Yeka A: Improved clinical skills after team-based, malaria case-management training of health care workers in Uganda. Malar J 2012, 11:44.
• [41]Shekelle P, Ortiz E, Rhodes S, Morton S, Eccles M, Grimshaw J, Woolf S: Validity of agency for healthcare research and practice guidelines: how quickly do guidelines become outdated? JAMA 2001, 286:1461-1467.
• [42]Center for the Evaluation of Value and Risk in Health: Cost Effectiveness Analysis Registry. [https://research.tufts-nemc.org/cear4/ webcite]
• [43]Mira J, Denis AA: The cost-effectiveness of preventing mother-to-child transmission of HIV in low- and middle-income countries: systematic review. Cost Eff Resour Alloc 2011, 9:3.
• [44]The Petra Study Team: Efficacy of three short-course regimens of zidovudine and lamivudine in preventing early and late transmission of HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra study): a randomised, double-blind, placebo-controlled trial. Lancet 2002, 359:1178-1186.