The exit interview as a proxy measure of malaria case management practice: sensitivity and specificity relative to direct observation

BMC Health Services Research

Manuel W Hetzel⁴  Ivo Mueller³  Peter M Siba¹  Justin Pulford² 

[1] Papua New Guinea Institute of Medical Research (PNGIMR), Goroka EHP 441, Papua New Guinea;School of Population Health, The University of Queensland, Herston Qld 4006, Australia;Walter and Eliza Hall Institute of Medical Research, Melbourne, Australia;University of Basel, Petersplatz 1, Basel, 4003, Switzerland

关键词: Adherence;    Patient recall;    Direct observation;    Exit interview;    Malaria;   

Others  :  1090218
DOI  :  10.1186/s12913-014-0628-8

 received in 2014-07-31, accepted in 2014-11-24,  发布年份 2014

【 摘 要 】

Background

This paper aims to assess the sensitivity and specificity of exit interviews as a measure of malaria case management practice as compared to direct observation.

Methods

The malaria case management of 1654 febrile patients attending 110 health facilities from across Papua New Guinea was directly observed by a trained research officer as part of a repeat cross sectional survey. Patient recall of 5 forms of clinical advice and 5 forms of clinical action were then assessed at service exit and statistical analyses on matched observation/exit interview data conducted.

Results

The sensitivity of exit interviews with respect to clinical advice ranged from 36.2% to 96.4% and specificity from 53.5% to 98.6%. With respect to clinical actions, sensitivity of the exit interviews ranged from 83.9% to 98.3% and specificity from 70.6% to 98.1%.

Conclusion

The exit interview appears to be a valid measure of objective malaria case management practices such as the completion of a diagnostic test or the provision of antimalarial medication, but may be a less valid measure of low frequency, subjective practices such as the provision of malaria prevention advice.

【 授权许可】

   
2014 Pulford et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Guidelines for the Treatment of Malaria. 2nd edition. WHO, Geneva; 2010.
• [2]Pulford J, Kurumop S, Ura Y, Siba P, Mueller I, Hetzel MW: Malaria case management in Papua New Guinea following the introduction of a revised treatment protocol. Malar J 2013, 12:433. BioMed Central Full Text
• [3]Juma E, Zurovac D: Changes in health workers’ malaria diagnosis and treatment practices in Kenya. Malar J 2011, 10:1. BioMed Central Full Text
• [4]Abdelgader TM, Ibrahim AM, Elmardi KA, Githinji S, Zurovac D, Snow RW, Noor AM: Progress towards implementation of ACT malaria case-management in public health facilities in the Republic of Sudan: a cluster-sample survey. BMC Public Health 2012, 12:11. BioMed Central Full Text
• [5]Martins JS, Zwi AB, Hobday K, Bonaparte F, Kelly PM: The implementation of a new Malaria Treatment Protocol in Timor-Leste: challenges and constraints. Health Policy Plan 2012, 27(8):677-686.
• [6]Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, Snow RW: The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet 2011, 378(9793):795-803.
• [7]Wasunna B, Zurovac D, Bruce J, Jones C, Webster J, Snow RW: Health worker performance in the management of paediatric fevers following in-service training and exposure to job aids in Kenya. Malar J 2010, 9:261.
• [8]Namagembe A, Ssekabira U, Weaver MR, Blum N, Burnett S, Dorsey G, Sebuyira LM, Ojaku A, Schneider G, Willis K, Yeka A: Improved clinical and laboratory skills after team-based, malaria case management training of health care professionals in Uganda. Malar J 2012, 11:44. BioMed Central Full Text
• [9]Pulford J, Mueller I, Siba PM, Hetzel MW: Malaria case management in Papua New Guinea prior to the introduction of a revised treatment protocol. Malar J 2012, 11:157. BioMed Central Full Text
• [10]Lange S, Mwisongo A, Maestad O: Why don’t clinicians adhere more consistently to guidelines for the Integrated Management of Childhood Illness (IMCI)? Soc Sci Med 2014, 104:56-63.
• [11]Masanja IM, Selemani M, Khatib RA, Amuri B, Kuepfer I, Kajungu D, de Savigny D, Kachur SP, Skarbinski J: Correct dosing of artemether-lumefantrine for management of uncomplicated malaria in rural Tanzania: do facility and patient characteristics matter? Malar J 2013, 12:446. BioMed Central Full Text
• [12]Kyabayinze DJ, Asiimwe C, Nakanjako D, Nabakooza J, Counihan H, Tibenderana JK: Use of RDTs to improve malaria diagnosis and fever case management at primary health care facilities in Uganda. Malar J 2010, 9:200. BioMed Central Full Text
• [13]Onwujekwe O, Uzochukwu B, Dike N, Uguru N, Nwobi E, Shu E: Malaria treatment perceptions, practices and influences on provider behaviour: comparing hospitals and non-hospitals in south-east Nigeria. Malar J 2009, 8:246. BioMed Central Full Text
• [14]Hrisos S, Eccles MP, Francis JJ, Dickinson HO, Kaner EF, Beyer F, Johnston M: Are there valid proxy measures of clinical behaviour? A systematic review. Implementation Sci 2009, 4:37. BioMed Central Full Text
• [15]Nicholson JM, Hennrikus DJ, Lando HA, McCarty MC, Vessey J: Patient recall versus physician documentation in report of smoking cessation counselling performed in the inpatient setting. Tob Control 2000, 9(4):382-388.
• [16]Shaikh U, Nettiksimmons J, Bell RA, Tancredi D, Romano PS: Accuracy of parental report and electronic health record documentation as measures of diet and physical activity counseling. Acad Pediatr 2012, 12(2):81-87.
• [17]Corser W, Sikorskii A, Olomu A, Stommel M, Proden C, Holmes-Rovner M: Concordance between comorbidity data from patient self-report interviews and medical record documentation. BMC Health Serv Res 2008, 8:85. BioMed Central Full Text
• [18]Flocke SA, Stange KC: Direct observation and patient recall of health behavior advice. Prev Med 2004, 38(3):343-349.
• [19]Stange KC, Zyzanski SJ, Smith TF, Kelly R, Langa DM, Flocke SA, Jaen CR: How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patients visits. Med Care 1998, 36(6):851-867.
• [20]Dickinson HO, Hrisos S, Eccles MP, Francis J, Johnston M: Statistical considerations in a systematic review of proxy measures of clinical behaviour. Implementation Sci 2010, 5:20. BioMed Central Full Text
• [21]Hetzel MW, Pulford J, Maraga S, Barnedas C, Reimer L, Tavul L, Jamea-Maiasa S, Tandrapah A, Maalsen A, Makita L, Siba PM, Mueller I: Evaluation of the Global Fund-supported National Malaria Control Program in Papua New Guinea, 2009–2014.P N G Med J, in press.
• [22]Kurumop SF, Pulford J, Mueller I, Siba P, Hetzel MW: Diagnostic capacity and anti-malarial availability in Papua New Guinea prior to the introduction of a revised national malaria treatment protocol.P N G Med J, in press.
• [23]National Malaria Treatment Protocol. 1st edition. PNG NDoH, Port Moresby; 2009.
• [24]Sciamanna CN, Goldstein MG, Marcus BH, Lawrence K, Pinto BM: Accuracy of recall of exercise counseling among primary care patients. Prev Med 2004, 39(6):1063-1067.
• [25]Gerbert B, Stone G, Stulbarg M, Gullion DS, Greenfield S: Agreement among physician assessment methods. Searching for the truth among fallible methods. Med Care 1988, 26(6):519-535.
• [26]Wilson A, McDonald P: Comparison of patient questionnaire, medical record, and audio tape in assessment of health promotion in general practice consultations. BMJ 1994, 309(6967):1483-1485.
• [27]Pbert L, Adams A, Quirk M, Hebert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol 1999, 18(2):183-188.
• [28]Reif S, Horgan CM, Ritter GA: Treatment services: triangulation of methods when there is no gold standard. Subst Use Misuse 2011, 46(5):620-632.
• [29]Tisnado DM, Adams JL, Liu H, Damberg CL, Chen WP, Hu FA, Carlisle DM, Mangione CM, Kahn KL: What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care 2006, 44(2):132-140.
• [30]Berkman ND, Davis TC, McCormack L: Health literacy: what is it? J Health Commun 2010, 15(Suppl 2):9-19.
• [31]Wilson EA, Wolf MS, Curtis LM, Clayman ML, Cameron KA, Eigen KV, Makoul G: Literacy, cognitive ability, and the retention of health-related information about colorectal cancer screening. J Health Commun 2010, 15(Suppl 2):116-125.
• [32]Sheridan SL, Halpern DJ, Viera AJ, Berkman ND, Donahue KE, Crotty K: Interventions for individuals with low health literacy: a systematic review. J Health Commun 2011, 16(Suppl 3):30-54.