Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach

Implementation Science

Bryan R. Garner²  Susan H. Godley³  Mary E. Slaughter⁴  Bing Han¹  Sarah B. Hunter¹ 

[1] RAND, 1776 Main Street, Santa Monica 90407-2138, CA, USA;Research Triangle Institute, 3040 E. Cornwallis Rd. Research Triangle Park, Raleigh 27675, NC, USA;Chestnut Health Systems, 448 Wylie Dr, Normal 61761, IL, USA;RAND, 4570 Fifth Ave., Suite 600, Pittsburgh 15213, PA, USA

关键词: Program sustainment;    Adolescent;    Substance use treatment;   

Others  :  1235171
DOI  :  10.1186/s13012-015-0364-4

 received in 2015-05-24, accepted in 2015-12-22,  发布年份 2015

【 摘 要 】

Background

Few empirical studies longitudinally examine evidence-based practice (EBP) sustainment and the hypothesized factors that influence it. In an effort to address this gap, the current study examined sustainment of an EBP for adolescent substance use called the adolescent community reinforcement approach (A-CRA).

Methods

A-CRA sustainment was assessed via information collected as part of key informant interviews and surveys with clinical staff from community-based treatment organizations that had received federal funding to implement A-CRA. Administrative data from the funding period on implementation was also used. Using discrete-time survival analysis, we regressed A-CRA sustainment on several factors theorized to influence EBP sustainment. Factors examined included outer setting, inner setting, implementation quality during the funding period, and intervention-related characteristics.

Results

Overall, data from 83 % of the targeted sample of treatment organizations was collected. A-CRA sustainment was strongly related to the time since funding loss. Strong relationships were found between sustainment status and implementation quality during the funding period, agency focus, funding stability, and political support for the treatment along with staff perceptions of the treatment’s complexity and implementation difficulty.

Conclusions

Consistent with the Consolidated Framework for Implementation Research, the current study found several factors related to the outer setting (e.g., funding stability), inner setting (e.g., agency focus), implementation quality during the funding period (e.g., staff trained, clients served), and characteristics of the intervention (e.g., implementation complexity) to be associated with EBP sustainment. Future research is warranted to examine the extent to which these relationships are stable over time. Efforts to ensure that adequate implementation occurs during the initial implementation period and that adequate funding, infrastructure, and staff support following the ending of initial support are critical to a program’s survival.

【 授权许可】

   
2015 Hunter et al.

【 图 表 】

Fig. 1.

【 参考文献 】

• [1]Godley SH, Godley MD, Hagen RJ. Community resources: a practical guide for human service professionals. Alcohol-drug treatment programs. Crimando W, Riggar TF, editors. Waveland Press, Inc., Prospect Heights, IL; 2005.
• [2]Stevens SJ, Morral AR. Adolescent substance abuse treatment in the United States: exemplary models from a national evaluation study. Haworth Press, New York; 2003.
• [3]Dennis M, Godley SH, Diamond G, Tims FM, Babor T, Donaldson J et al.. The Cannabis Youth Treatment (CYT) study: main findings from two randomized trials. J Subst Abuse Treat. 2004; 27(3):197-213.
• [4]Gans J, Falco M, Schackman BR, Winters KC. An in-depth survey of the screening and assessment practices of highly regarded adolescent substance abuse treatment programs. J Child Adolesc Subst Abuse. 2010; 19(1):33-47.
• [5]Schackman BR, Rojas EG, Gans J, Falco M, Millman RB. Does higher cost mean better quality? Evidence from highly-regarded adolescent drug treatment programs. BioMed Central Ltd. 2007; 2:23.
• [6]The economic impact of illicit drug use on American society/U.S. Department of Justice, National Drug Intelligence Center. U.S. Department of Justice National Drug Intelligence Center; 2011, Johnstown, Pa; 2011.
• [7]Smoking-attributable mortality, years of potential life lost, and productivity losses United States, 2000–2004. Centers for Disease Control and Prevention, Atlanta, GA; 2008.
• [8]Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet. 2009; 373(9682):2223-33.
• [9]Godley MD, Godley SH, Dennis ML, Funk RR, Passetti LL. The effect of assertive continuing care on continuing care linkage, adherence and abstinence following residential treatment for adolescents with substance use disorders. Addiction. 2007; 102(1):81-93.
• [10]Slesnick N, Prestopnik JL, Meyers RJ, Glassman M. Treatment outcome for street-living, homeless youth. Addict Behav. 2007; 32(6):1237-51.
• [11]Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clin Psychol (New York). 2011; 18(1):67-83.
• [12]Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009; 36(1):24-34.
• [13]Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ et al.. Sustainability science: an integrated approach for health-programme planning. Lancet. 2008; 372(9649):1579-89.
• [14]Scheirer MA, Hartling G, Hagerman D. Defining sustainability outcomes of health programs: illustrations from an on-line survey. Eval Program Plann. 2008; 31(4):335-46.
• [15]Ellis P, Robinson P, Ciliska D, Armour T, Raina P, Brouwers M et al.. Diffusion and dissemination of evidence-based cancer control interventions. Evid Rep Technol Assess (Summ). 2003; 79(79):1-5.
• [16]O’Loughlin J, Renaud L, Richard L, Gomez LS, Paradis G. Correlates of the sustainability of community-based heart health promotion interventions. Prev Med. 1998; 27(5 Pt 1):702-12.
• [17]Pluye P, Potvin L, Denis JL, Pelletier J, Mannoni C. Program sustainability begins with the first events. Eval Program Plann. 2005; 28(2):123-37.
• [18]Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998; 13(1):87-108.
• [19]Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009; 4:50. BioMed Central Full Text
• [20]Rogers EM. Diffusion of innovations. 5th ed. Free Press, New York; 2003.
• [21]Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004; 82(4):581-629.
• [22]Fixsen DL. Implementation research: a synthesis of the literature. National Implementation Research Network, Tampa, Florida; 2005.
• [23]Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Med Care Res Rev. 2004; 61(3 Suppl):12S-30S.
• [24]Garner BR, Barnes B, Godley SH. Monitoring fidelity in the adolescent community reinforcement approach (A-CRA): the training process for A-CRA raters. J Behav Anal Health Sports Fit Med. 2009; 2(1):43-54.
• [25]Simpson DD. A conceptual framework for transferring research to practice. J Subst Abuse Treat. 2002; 22(4):171-82.
• [26]Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011; 38(1):4-23.
• [27]Scheirer MA, Dearing JW. An agenda for research on the sustainability of public health programs. Am J Public Health. 2011; 101(11):2059-67.
• [28]Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. BioMed Central Ltd. 2012; 7:17.
• [29]Tibbits MK, Bumbarger BK, Kyler SJ, Perkins DF. Sustaining evidence-based interventions under real-world conditions: results from a large-scale diffusion project. Prev Sci. 2010; 11(3):252-62.
• [30]Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014; 41(3):337-46.
• [31]Swain K, Whitley R, McHugo GJ, Drake RE. The sustainability of evidence-based practices in routine mental health agencies. Community Ment Health J. 2010; 46(2):119-29.
• [32]Cooper BR, Bumbarger BK, Moore JE. Sustaining evidence-based prevention programs: correlates in a large-scale dissemination initiative. Prev Sci. 2015; 16(1):145-57.
• [33]Eby LT, Burk H, Maher CP. How serious of a problem is staff turnover in substance abuse treatment? A longitudinal study of actual turnover. J Subst Abuse Treat. 2010; 39(3):264-71.
• [34]Substance Abuse & Mental Health Services Administration. Application information Center for Substance Abuse Treatment (CSAT). http://media.samhsa.gov/Grants/2009/ti_09_002.aspx. Accessed 26 October 2015.
• [35]Results from the 2010 national survey on drug use and health: summary of national findings. National survey on drug use and health series. U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality, Rockville, MD; 2011.
• [36]Dillman DA, Smyth JD, Christian LM, Dillman DA. Internet, mail, and mixed-mode surveys: the tailored design method. 3rd ed. Wiley, Hoboken, N.J.; 2009.
• [37]Abuse S, Administration MHS. National survey of substance abuse treatment services (N-SSATS): 2010. Data on substance abuse treatment facilities. National survey on drug use and health series, vol S-59. U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality, Rockville, MD; 2011.
• [38]Schell SF, Luke DA, Schooley MW, Elliott MB, Herbers SH, Mueller NB et al.. Public health program capacity for sustainability: a new framework. Implement Sci. 2013; 8:15. BioMed Central Full Text
• [39]Washington University in St Louis. Program sustainability assessment tool. https://sustaintool.org/. Accessed 27 October 2015.
• [40]Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manage Rev. 1996; 21(4):1055-80.
• [41]Steckler A, Goodman RM, McLeroy KR, Davis S, Koch G. Measuring the diffusion of innovative health promotion programs. Am J Health Promot. 1992; 6(3):214-24.
• [42]Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Stat. 2001; 29(4):1165-88.
• [43]Singer JD, Willett JB. It’s about time: using discrete-time survival analysis to study duration and the timing of events. J Educ Behav Stat. 1993; 18(2):155-95.
• [44]Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Am J Eval. 2005; 26(3):320-47.
• [45]Goodman RM, McLeroy KR, Steckler AB, Hoyle RH. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993; 20(2):161-78.
• [46]Godley SH, Smith JE, Passetti LL, Subramaniam G. The adolescent community reinforcement approach (A-CRA) as a model paradigm for the management of adolescents with substance use disorders and co-occurring psychiatric disorders. Subst Abus. 2014; 35(4):352-63.
• [47]Hunter BD, Godley SH, Hesson-McInnis MS, Roozen HG. Longitudinal change mechanisms for substance use and illegal activity for adolescents in treatment. Psychol Addict Behav. 2014; 28(2):507-15.
• [48]Godley SH, Hunter BD, Fernandez-Artamendi S, Smith JE, Meyers RJ, Godley MD. A comparison of treatment outcomes for adolescent community reinforcement approach participants with and without co-occurring problems. J Subst Abuse Treat. 2014; 46(4):463-71.
• [49]Substance Abuse & Mental Health Services Administration. Cooperative agreements for State Adolescent Treatment Enhancement and Dissemination (SAT-ED). http://media.samhsa.gov/grants/2012/ti_12_006.aspx
• [50]Hunter S, Godley S, Garner B, Han B, Ayer L, Slaughter M, et al. The sustainment of evidence-based adolescent substance abuse treatment in community settings. Addict Sci Clin Pract. 2015;10 Suppl 1:A23.
• [51]Substance Abuse and Mental Health Services Administration . Office of Applied Studies. Treatment Episode Data Set (TEDS): 2007. vol S-51. Rockville, MD: U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality; 2007.