Immediate versus sustained effects: interrupted time series analysis of a tailored intervention

Implementation Science

Heather Holmes²  Duncan Chambers³  Paul M Wilson³  Carl Thompson¹  Katherine Farley¹  Andria Hanbury¹ 

[1] Department of Health Sciences, University of York, Heslington, York YO10 5DD, UK;West and South Yorkshire Bassetlaw Commissioning Support Unit, Douglas Mill, Bowling Old Lane, Bradford BD5 7RJ, UK;Centre for Reviews and Dissemination, University of York, Heslington, York YO10 5DD, UK

关键词: Educational materials;    Reminders;    Educational meetings;    Sustainability;    Process evaluation;    Time series;   

Others  :  810876
DOI  :  10.1186/1748-5908-8-130

 received in 2013-04-25, accepted in 2013-10-30,  发布年份 2013

【 摘 要 】

Background

Detailed intervention descriptions and robust evaluations that test intervention impact—and explore reasons for impact—are an essential part of progressing implementation science. Time series designs enable the impact and sustainability of intervention effects to be tested. When combined with time series designs, qualitative methods can provide insight into intervention effectiveness and help identify areas for improvement for future interventions. This paper describes the development, delivery, and evaluation of a tailored intervention designed to increase primary health care professionals’ adoption of a national recommendation that women with mild to moderate postnatal depression (PND) are referred for psychological therapy as a first stage treatment.

Methods

Three factors influencing referral for psychological treatment were targeted using three related intervention components: a tailored educational meeting, a tailored educational leaflet, and changes to an electronic system data template used by health professionals during consultations for PND. Evaluation comprised time series analysis of monthly audit data on percentage referral rates and monthly first prescription rates for anti-depressants. Interviews were conducted with a sample of health professionals to explore their perceptions of the intervention components and to identify possible factors influencing intervention effectiveness.

Results

The intervention was associated with a significant, immediate, positive effect upon percentage referral rates for psychological treatments. This effect was not sustained over the ten month follow-on period. Monthly rates of anti-depressant prescriptions remained consistently high after the intervention. Qualitative interview findings suggest key messages received from the intervention concerned what appropriate antidepressant prescribing is, suggesting this to underlie the lack of impact upon prescribing rates. However, an understanding that psychological treatment can have long-term benefits was also cited. Barriers to referral identified before intervention were cited again after the intervention, suggesting the intervention had not successfully tackled the barriers targeted.

Conclusion

A time series design allowed the initial and sustained impact of our intervention to be tested. Combined with qualitative interviews, this provided insight into intervention effectiveness. Future research should test factors influencing intervention sustainability, and promote adoption of the targeted behavior and dis-adoption of competing behaviors where appropriate.

【 授权许可】

   
2013 Hanbury et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

【 参考文献 】

• [1]Michie S, et al.: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci 2009, 4:40. BioMed Central Full Text
• [2]Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Pettigrew M: Developing and evaluating complex interventions: new guidance. London: M.R. Council, Editor; 2008.
• [3]Cook T, Campbell DT: Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally; 1979.
• [4]Ramsey CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE: Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behaviour change strategies. Int J Technol Assess Health Care 2003, 19(4):613-623.
• [5]Rogers E: Diffusion of Innovations. 5th edition. London: Free Press; 2003.
• [6]NICE: NICE implementation uptake report: statins for the prevention of cardiovascular events. London: National Institute for Health and Care Excellence; 2008.
• [7]Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M: The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci 2012., 7(17) doi: 10.1186/1748-5908-7-17
• [8]Bowman CC, et al.: Measuring persistence of implementation: QUERI Series. Implement Sci 2008, 3:21. BioMed Central Full Text
• [9]Mason J, et al.: When is it cost-effective to change the behavior of health professionals? JAMA 2001, 286(23):2988-2992.
• [10]Hanbury A, Farley K, Thompson C, Wilson P, Chambers D: Challenges in identifying barriers to adoption in a theory-based implementation study: lessons for future implementation studies. BMC Health Serv Res 2012, 12:422. BioMed Central Full Text
• [11]Adams AS, et al.: Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health Care 1999, 11(3):187-192.
• [12]NICE: Antenatal and Post-natal Mental Health. The NICE Guideline on Clinical Management and Service Guidance. London: The British Psychological Society & The Royal College of Psychiatrists; 2007.
• [13]Morse JN, Niehaus L: Mixed Method Design: Principles and Procedures. CA, USA: Walnut Creek; 2009. Left Coast Press
• [14]Greenhalgh T, et al.: Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004, 82(4):581-629.
• [15]Grimshaw JM, Eccles MP, Lavis JN, Hill SH, Squires JE: Knowledge translation of research findings. Implement Sci 2012., 7(50) doi: 10.1186/1748-5908-7-50
• [16]Michie S, van Stralen MM, West R: The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci 2011., 6(42) doi: 10.1186/1748-5908-6-42
• [17]Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, Makosso-Kallyth S, Wolf FM, Farmer AP, Gagnon MP: Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012., 10doi: 10.1002/14651858
• [18]Grimshaw JM, et al.: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004, 8(6):1-72.
• [19]Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf FM, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes (review). Cochrane Database Syst Rev 2009., 2
• [20]Shojania K, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J: The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev 2009, 3:CD001096.
• [21]Pope C, Ziebland S, Mays N: Analysing qualitative data. Br Med J 2000, 320:114-116.
• [22]Redmund WH: Product dis-adoption: quitting smoking as a diffusion process. J Public Policy Mark 1996, 15(1):87-97.