Implementation Science | |
Exploring sources of variability in adherence to guidelines across hospitals in low-income settings: a multi-level analysis of a cross-sectional survey of 22 hospitals | |
Elizabeth Allen3  Jim Todd5  Michael Boele van Hensbroek1  Mike English4  David Gathara2  | |
[1] Department of Global Health, Academic Medical Centre, University of Amsterdam, Amsterdam, UK;KEMRI Wellcome Trust Research Programme, Nairobi, 43640 – 00100, Kenya;Department of Medical Statistics, London School of Hygiene and Tropical Medicine, London, UK;Nuffield Department of Medicine, University of Oxford, Oxford, UK;Department of Population Health, London School of Hygiene and Tropical Medicine, London, UK | |
关键词: Diarrhoea/dehydration; Malaria; Pneumonia; Multi-level models; Low-income settings; Clinicians; Hospitals; Paediatrics; Variability; Intra-class correlation; | |
Others : 1218393 DOI : 10.1186/s13012-015-0245-x |
|
received in 2014-11-11, accepted in 2015-04-11, 发布年份 2015 | |
【 摘 要 】
Background
Variability in processes of care and outcomes has been reported widely in high-income settings (at geographic, hospital, physician group and individual physician levels); however, such variability and the factors driving it are rarely examined in low-income settings.
Methods
Using data from a cross-sectional survey undertaken in 22 hospitals (60 case records from each hospital) across Kenya that aimed at evaluating the quality of routine hospital services, we sought to explore variability in four binary inpatient paediatric process indicators. These included three prescribing tasks and use of one diagnostic. To examine for sources of variability, we examined intra-class correlation coefficients (ICC) and their changes using multi-level mixed models with random intercepts for hospital and clinician levels and adjusting for patient and clinician level covariates.
Results
Levels of performance varied substantially across indicators and hospitals. The absolute values for ICCs also varied markedly ranging from a maximum of 0.48 to a minimum of 0.09 across the models for HIV testing and prescription of zinc, respectively. More variation was attributable at the hospital level than clinician level after allowing for nesting of clinicians within hospitals for prescription of quinine loading dose for malaria (ICC = 0.30), prescription of zinc for diarrhoea patients (ICC = 0.11) and HIV testing for all children (ICC = 0.43). However, for prescription of correct dose of crystalline penicillin, more of the variability was explained by the clinician level (ICC = 0.21). Adjusting for clinician and patient level covariates only altered, marginally, the ICCs observed in models for the zinc prescription indicator.
Conclusions
Performance varied greatly across place and indicator. The variability that could be explained suggests interventions to improve performance might be best targeted at hospital level factors for three indicators and clinician factors for one. Our data suggest that better understanding of performance and sources of variation might help tailor improvement interventions although further data across a larger set of indicators and sites would help substantiate these findings.
【 授权许可】
2015 Gathara et al.; licensee BioMed Central.
【 预 览 】
Files | Size | Format | View |
---|---|---|---|
20150710123101574.pdf | 376KB | download |
【 参考文献 】
- [1]Laws RA, Jayasinghe UW, Harris MF, Williams AM, Powell Davies G, Kemp LA. Explaining the variation in the management of lifestyle risk factors in primary health care: a multilevel cross sectional study. BMC Public Health. 2009; 9:165. BioMed Central Full Text
- [2]Jarman B, Gault S, Alves B, Hider A, Dolan S. Explaining differences in English hospital death rates using routinely collected data. BMJ. 1999; 318(June):1515-20.
- [3]Ayieko P, Okiro EA, Edwards T, Nyamai R, English M. Variations in mortality in children admitted with pneumonia to Kenyan hospitals. PLoS One. 2012; 7: Article ID e47622
- [4]Gathara D, Nyamai R, Were F, Mogoa W, Karumbi J, Kihuba E, et al. Moving towards routine QoC assessment in paediatrics. PLoS One. 2015;10:3,e011117048.
- [5]Janjua NZ, Khan MI, Clemens JD. Estimates of intraclass correlation coefficient and design effect for surveys and cluster randomized trials on injection use in Pakistan and developing countries. Trop Med Int Health. 2006; 11:1832-40.
- [6]Pagel C, Prost A, Lewycka S, Das S, Colbourn T, Mahapatra R et al.. Intracluster correlation coefficients and coefficients of variation for perinatal outcomes from five cluster-randomised controlled trials in low and middle-income countries: results and methodological implications. Trials. 2011; 12:151. BioMed Central Full Text
- [7]Davis P, Gribben B, Lay-Yee R, Scott A. How much variation in clinical activity is there between general practitioners? A multi-level analysis of decision-making in primary care. J Health Serv Res Policy. 2002; 7:202-8.
- [8]Turenne MN, Hirth RA, Pan Q, Wolfe RA, Messana JM, Wheeler JRC. Using knowledge of multiple levels of variation in care to target performance incentives to providers. Med Care. 2008; 46:120-6.
- [9]Hollingsworth JM, Krein SL, Dunn RL, Wolf JS, Hollenbeck BK. Understanding variation in the adoption of a new technology in surgery. Med Care. 2008; 46:366-71.
- [10]Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ et al.. Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009; 338:b780.
- [11]Lilford RJ, Brown CA, Nicholl J. Use of process measures to monitor the quality of clinical practice. BMJ. 2007,335:648 (September).
- [12]Lilford R, Pronovost P. Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. BMJ. 2010; 340:c2016.
- [13]English M, Nzinga J, Mbindyo P, Ayieko P, Irimu G, Mbaabu L. Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals–interpretation based on retrospective examination of data from participant observation, quantitative and qualitative studies. Implement Sci. 2011; 6:124. BioMed Central Full Text
- [14]English M, Gathara D, Mwinga S, Ayieko P, Opondo C, Aluvaala J et al.. Adoption of recommended practices and basic technologies in a low-income setting. Arch Dis Child. 2014; 99:452-6.
- [15]Killip S, Mahfoud Z, Pearce K. What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med. 2004; 2(3):204-8.
- [16]Selby JV, Schmittdiel JA, Lee J, Fung V, Thomas S, Smider N et al.. Meaningful variation in performance: what does variation in quality tell us about improving quality? Med Care. 2010; 48:133-9.
- [17]Aluvaala J, Nyamai R, Were F, Wasunna A, Kosgei R, Karumbi J, et al. Assessment of neonatal care in clinical training facilities in Kenya. Arch Dis Child. 2014;306–423.
- [18]Ayieko P, Ntoburi S, Wagai J, Opondo C, Opiyo N, Migiro S et al.. A multifaceted intervention to implement guidelines and improve admission paediatric care in Kenyan district hospitals: a cluster randomised trial. PLoS Med. 2011; 8: Article ID e1001018
- [19]Ntoburi S, Hutchings A, Sanderson C, Carpenter J, Weber M, English M. Development of paediatric quality of inpatient care indicators for low-income countries - a Delphi study. BMC Pediatr. 2010; 10:90. BioMed Central Full Text
- [20]Flodgren G, Conterno LO, Mayhew A, Omar O, Pereira CR, Shepperd S. Interventions to improve professional adherence to guidelines for prevention of device-related infections. Cochrane Database Syst Rev. 2013; 3: Article ID CD006559
- [21]Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A et al.. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012; 10: Article ID CD004398
- [22]Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011; 6:42. BioMed Central Full Text
- [23]Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ. Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004; 57:785-94.
- [24]Taljaard M, Donner A, Villar J, Wojdyla D, Velazco A, Bataglia V et al.. Intracluster correlation coefficients from the 2005 WHO Global Survey on Maternal and Perinatal Health: implications for implementation research. Paediatr Perinat Epidemiol. 2008; 22:117-25.
- [25]Haddad SM, Sousa MH, Cecatti JG, Parpinelli MA, Costa ML, Souza JP. Intraclass correlation coefficients in the Brazilian Network for Surveillance of Severe Maternal Morbidity study. BMC Pregnancy Childbirth. 2012; 12:101. BioMed Central Full Text
- [26]Sullivan CO, Omar RZ, Forrest CB, Majeed A. Adjusting for case mix and social class in examining variation in home visits between practices. Fam Pract. 2004; 21:355-63.
- [27]Ohlsson H, Merlo J. Understanding the effects of a decentralized budget on physicians’ compliance with guidelines for statin prescription–a multilevel methodological approach. BMC Health Serv Res. 2007; 7:68. BioMed Central Full Text
- [28]Krein SL, Hofer TP, Kerr EA, Hayward RA. Whom should we profile? Examining diabetes care practice variation among primary care providers, provider groups, and health care facilities. Health Serv Res. 2002; 37:1159-80.
- [29]Resnicow K, Zhang N, Vaughan RD, Reddy SP, James S, Murray DM. When intraclass correlation coefficients go awry: a case study from a school-based smoking prevention study in South Africa. Am J Public Health. 2010; 100:1714-8.
- [30]Paterson L, Goldstein H. New statistical methods for analysing social structures: an introduction to multilevel models. Br Educ Res J. 1991; 17:387-93.
- [31]Donner A, Klar N. Pitfalls of and controversies in cluster randomization trials. Am J Public Health. 2004; 94:416-22.
- [32]Fung V, Schmittdiel JA, Fireman B, Meer A, Thomas S, Smider N et al.. Meaningful variation in performance: a systematic literature review. Med Care. 2010; 48:140-8.
- [33]Huang I-C, Diette GB, Dominici F, Frangakis C, Wu AW. Variations of physician group profiling indicators for asthma care. Am J Manag Care. 2005; 11:38-44.
- [34]Greene WH, William H. Econometric analysis. 6th ed. PEARSON Prentice Hall, Upper Saddle River, New Jersey; 2008.
- [35]Hausman JA. Specification tests in econometrics. ECONOMETRICA. 1978; 46:1251-71.