Can we trust measures of healthcare utilization from household surveys?

BMC Public Health

Timothy Powell-Jackson²  Evelyn Korkor Ansah¹ 

[1]Research & Development Division, Ghana Health Service, P.O. Box MB-190, Accra, Ghana

[2]Department of Global Health & Development, London School of Hygiene & Tropical Medicine, 15-17 Tavistock Place, London WC1H 9SH, UK

关键词: Health surveys;    Recall periods;    Healthcare utilization;    Pictorial diary;   

Others  :  1161777
DOI  :  10.1186/1471-2458-13-853

 received in 2013-03-19, accepted in 2013-09-10,  发布年份 2013

【 摘 要 】

Background

The research community relies heavily on measures of healthcare utilization from household surveys to understand health seeking choices and to evaluate interventions in developing countries. Such measures are known to suffer from recall problems but there is limited evidence of whether the method of data collection affects evaluation findings. We compared the results of a randomized trial of free healthcare using utilization data from two sources.

Methods

Data are from a study in Ghana, in which 2,194 households containing 2,592 children under 5 y old were randomized into a prepayment scheme providing free primary and some referral care, or to a control group whose families paid user fees for healthcare. Data on morbidity and health seeking behaviour were collected using a standard household survey administered at endline and a pictorial diary given to households over a six month period, collected at monthly intervals.

Results

Self-reported measures of morbidity and healthcare utilization were substantially lower in the household survey than the pictorial diary when the recall period was over a month. Introducing free healthcare had a positive effect on primary care visits based on the pictorial diary and a non-significant negative effect according to the household survey. Using any clinic visit in the past month as the outcome, the difference in the effect of free care between the two data collection methods was 3.6 percentage points (p = 0.078).

Conclusions

The findings raise methodological concerns about measures of healthcare utilization from household surveys, particularly in the evaluation of health financing interventions.

【 授权许可】

   
2013 Ansah and Powell-Jackson; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

【 参考文献 】

• [1]King G, Gakidou E, Imai K, Lakin J, Moore RT, Nall C, Ravishankar N, Vargas M, Tellez-Rojo MM, Avila JE, Avila MH, Llamas HH: Public policy for the poor? A randomised assessment of the Mexican universal health insurance programme. Lancet 2009, 373:1447-1454.
• [2]Babiarz KS, Miller G, Yi H, Zhang L, Rozelle S: New evidence on the impact of China's New Rural Cooperative Medical Scheme and its implications for rural primary healthcare: multivariate difference-in-difference analysis. BMJ 2010, 341:c5617.
• [3]Wagstaff A, Lindelow M, Jun G, Ling X, Juncheng Q: Extending health insurance to the rural population: an impact evaluation of China's new cooperative medical scheme. J Health Econ 2009, 28:1-19.
• [4]Mills A, Ataguba JE, Akazili J, Borghi J, Garshong B, Makawia S, Mtei G, Harris B, Macha J, Meheus F, McIntyre D: Equity in financing and use of health care in Ghana, South Africa, and Tanzania: implications for paths to universal coverage. Lancet 2012, 380:126-133.
• [5]O'Donnell O, van Doorslaer E, Wagstaff A, Lindelow M: Analysing health equity using household survey data: a guide to techniques and their implementation. Washington DC: World Bank; 2008.
• [6]Sen A: Health: perception versus observation. BMJ 2002, 324:860-861.
• [7]Das J, Hammer J, Sanchez-Paramo C: The impact of recall periods on reported morbidity and health seeking behavior. J Dev Econ 2012, 98:76-88.
• [8]Arnold BF, Galiani S, Ram PK, Hubbard AE, Briceno B, Gertler PJ, Colford JM Jr: Optimal recall period for caregiver-reported illness in risk factor and intervention studies: a multicountry study. Am J Epidemiol 2013, 177:361-370.
• [9]Higgins J, Altman D, Sterne J: Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions Version 510 Edited by Higgins J, Green S. 2011. Available from http://www.cochrane-handbook.org webcite. The Cochrane Collaboration
• [10]Ansah EK, Narh-Bana S, Asiamah S, Dzordzordzi V, Biantey K, Dickson K, Gyapong JO, Koram KA, Greenwood BM, Mills A, Whitty CJ: Effect of removing direct payment for health care on utilisation and health outcomes in Ghanaian children: a randomised controlled trial. PLoS Med 2009, 6(1):48-58.
• [11]Powell-Jackson T, Hanson K, Whitty CJ, Ansah EK: Who Benefits from Removing User Fees for Health Care? Evidence from a Randomised Experiment in Ghana. 2012.
• [12]Wiseman V, Conteh L, Matovu F: Using diaries to collect data in resource-poor settings: questions on design and implementation. Health Policy Plan 2005, 20:394-404.
• [13]Witschi C: Short-term dietary recall and recording methods. In Nutritional Epidemiology. Edited by Willett W. New York: Oxford University Press; 1990.
• [14]Coxon A: Diaries and sexual behavior: The use of sexual diaries as method and substance in researching gay men’s response to HIV/AIDS. In Challenge and innovation and methodological advances in social research on HIV/AIDS: Social aspects of AIDS. Edited by Boulton M. London: Taylor & Francis; 1994.
• [15]Gillmore M, Gaylord J, Hartway J, Hoppe MJ, Morrison DM, Leigh BC, Rainey DT: Daily data collection of sexual and other health-related behaviors. J Sex Res 2001, 38:35-42.
• [16]Hornsby PP, Wilcox AJ: Validity of questionnaire information on frequency of coitus. Am J Epidemiol 1989, 130:94-99.
• [17]McAuliffe TL, DiFranceisco W, Reed BR: Effects of question format and collection mode on the accuracy of retrospective surveys of health risk behavior: a comparison with daily sexual activity diaries. Health Psychol 2007, 26:60-67.
• [18]Leigh BC, Gillmore MR, Morrison DM: Comparison of diary and retrospective measures for recording alcohol consumption and sexual activity. J Clin Epidemiol 1998, 51:119-127.
• [19]Poikolainen K, Karkkainen P: Diary gives more accurate information about alcohol consumption than questionnaire. Drug Alcohol Depend 1993, 11:209-216.
• [20]Coxon AP, Coxon NH, Weatherburn P, Hunt AJ, Hickson F, Davies PM, McManus TJ: Sex role separation in sexual diaries of homosexual men. AIDS 1993, 7:877-882.
• [21]Verbrugge LM: Health diaries. Med Care 1980, 18:73-95.
• [22]Whitty C, Jones RJ: A comparison of prospective and retrospective diary methods of assessing alcohol use among university undergraduates. J Public Health Med 1992, 14:264-270.
• [23]Wheeler L, Reis H: Self-recording of everyday life events: origins, types and uses. J Pers 1991, 59:339-354.
• [24]Stone AA, Kessler RC, Haythornthwaite JA: Measuring daily events and experiences: decisions for the researcher. J Pers 1991, 59:575-607.
• [25]Cannell C, Marguiz K, Laurent A: A Summary of Studies of Interviewing Methodology. Washington, D.C.: Government Printing Office; 1977.
• [26]OECD: Private health expenditure - report on the conclusions of the project: 11th meeting of health accounts experts and correspondents for health expenditure data. Paris: Organisation for Economic Co-operation and Development; 2009.
• [27]Ross DA, Vaughan JP: Health interview surveys in developing countries: a methodological review. Stud Fam Plann 1986, 17:78-94.