Policy to implementation: evidence-based practice in community mental health – study protocol

Implementation Science

David S Mandell⁷  Lucia Walsh⁷  Sonja Schoenwald²  Steven Marcus⁴  Kimberly Hoagwood⁶  Trevor Hadley⁷  Arthur Evans³  Frances Barg⁵  Gregory Aarons¹  Rinad S Beidas⁷ 

[1] Department of Psychiatry, University of California San Diego, San Diego, CA, USA;Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina, Charleston, SC, USA;Department of Behavioral Health and Intellectual DisAbility Services, Philadelphia, PA, USA;Center for Health Equity Research and Promotion, Philadelphia Veterans Affairs Medical Center; School of Social Policy and Practice, University of Pennsylvania, Philadelphia, PA, USA;Department of Family Medicine and Community Health, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA;Department of Psychiatry, New York University, New York, NY, USA;Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3rd floor, Philadelphia, PA, 19104, USA

关键词: Organizational variables;    Fidelity;    Implementation;    Policy;    Community mental health;    Evidence-based practice;   

Others  :  813729
DOI  :  10.1186/1748-5908-8-38

 received in 2013-02-23, accepted in 2013-03-18,  发布年份 2013

【 摘 要 】

Background

Evidence-based treatments (EBTs) are not widely available in community mental health settings. In response to the call for implementation of evidence-based treatments in the United States, states and counties have mandated behavioral health reform through policies and other initiatives. Evaluations of the impact of these policies on implementation are rare. A systems transformation about to occur in Philadelphia, Pennsylvania, offers an important opportunity to prospectively study implementation in response to a policy mandate.

Methods/design

Using a prospective sequential mixed-methods design, with observations at multiple points in time, we will investigate the responses of staff from 30 community mental health clinics to a policy from the Department of Behavioral Health encouraging and incentivizing providers to implement evidence-based treatments to treat youth with mental health problems. Study participants will be 30 executive directors, 30 clinical directors, and 240 therapists. Data will be collected prior to the policy implementation, and then at two and four years following policy implementation. Quantitative data will include measures of intervention implementation and potential moderators of implementation (i.e., organizational- and leader-level variables) and will be collected from executive directors, clinical directors, and therapists. Measures include self-reported therapist fidelity to evidence-based treatment techniques as measured by the Therapist Procedures Checklist-Revised, organizational variables as measured by the Organizational Social Context Measurement System and the Implementation Climate Assessment, leader variables as measured by the Multifactor Leadership Questionnaire, attitudes towards EBTs as measured by the Evidence-Based Practice Attitude Scale, and knowledge of EBTs as measured by the Knowledge of Evidence- Based Services Questionnaire. Qualitative data will include semi-structured interviews with a subset of the sample to assess the implementation experience of high-, average-, and low-performing agencies. Mixed methods will be integrated through comparing and contrasting results from the two methods for each of the primary hypotheses in this study.

Discussion

Findings from the proposed research will inform both future policy mandates around implementation and the support required for the success of these policies, with the ultimate goal of improving the quality of treatment provided to youth in the public sector.

【 授权许可】

   
2013 Beidas et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]Chambless DL, Ollendick TH: Empirically supported psychological interventions: controversies and evidence. Annu Rev Psychol 2001, 52:685-716.
• [2]Balas EA, Boren SA: Managing clinical knowledge for health care improvement. In Yearbook of Medical Informatics. Edited by Bemmel J, McCray AT. Stuttgart: Schattauer Verlagsgesellschaft; 2000:65-70.
• [3]New Freedom Commission on Mental Health: Achieving the Promise: Transforming Mental Health Care in America. Executive Summary. Rockville; 2003.
• [4]Aarons GA, Sommerfeld DH, Willging CE: The soft underbelly of system change: The role of leadership and organizational climate in turnover during statewide behavioral health reform. Psychol Serv 2011, 8:269-281.
• [5]Brownson RC, Chriqui JF, Stamatakis KA: Understanding evidence-based public health policy. Am J Public Health 2009, 99:1576-83.
• [6]Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood K, Mayberg S, Green P, Research Network on Youth Mental health: Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Adm Policy Ment Health 2008, 35:98-113.
• [7]Glisson C, James LR: The cross-level effects of culture and climate in human service teams. J Organ Behavior 2002, 23:767-794.
• [8]Glisson C, Green P: Organizational climate, services, and outcomes in child welfare systems. Child Abuse Negl 2011, 35:582-91.
• [9]Glisson C, Schoenwald SK, Hemmelgam A, Green P, Dukes D, Armstrong KS, Chapman JE: A randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. J Consult Clin Psychol 2010, 78:537-50.
• [10]Klein K, Knight A: Innovation implementation: overcoming the challenge. Cur Dir Psychol Sci 2005, 14:243-246.
• [11]Weiner BJ, Beiden CM, Bergmire DM, Johnston M: The meaning and measurement of implementation climate. Implement Sci 2011, 6:78. BioMed Central Full Text
• [12]Klein KJ, Conn AB, Sorra JS: Implementing computerized technology: an organizational analysis. J Appl Psych 2001, 86:811-824.
• [13]Bass B, Avolio B: Transformational Leadership Development: Manual for the Multifactor Leadership Questionnaire. Palo Alto: Consulting Psychologist Press; 1990.
• [14]Aarons GA: Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiatr Serv 2006, 57:1162-9.
• [15]Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011, 38:4-23.
• [16]Brownson RC, Royer C, Ewing R, McBride TD: Researchers and policymakers: travelers in parallel universes. Am J Prev Med 2006, 30:164-72.
• [17]Dinh-Zarr TB, Sleet D, Shults RA, Zaza S, Elder RW, Nichols JL, Thompson RS, Sosin DM, Task Force on Community Preventative Services: Reviews of evidence regarding interventions to increase the use of safety belts. Am J Prev Med 2001, 21:48-65.
• [18]Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M: Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health 2011, 38:65-76.
• [19]Schoenwald SK, Henngeller SW, Brondino MJ, Rowland MD: Multisystemic therapy: monitoring treatment fidelity. Fam Process 2000, 39:83-103.
• [20]Weersing VR, Weisz JR, Donenberg G: Development of the therapy procedures checklist: A therapist-report measure of technique use in child and adolescent treatment. J Clin Child Psychol 2002, 31:168-180.
• [21]McLeod BD, Weisz JR: The Therapy Process Observational Coding System for Child Psychotherapy-Strategies Scale. J Clin Child Adolesc Psychol 2010, 39:436-43.
• [22]Beidas RS, Kendall PC: Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol-Sci Pr 2010, 17:1-30.
• [23]Lehman WJ, Greener J, Simpson D: Assessing organizational readiness for change. J Subst Abuse Treat 2002, 22:197-209.
• [24]Helfrich CD, Li YF, Sharp ND, Sales AE: Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci 2009, 4:38. BioMed Central Full Text
• [25]Glisson C, Green P, Williams NJ: Assessing the Organizational Social Context (OSC) of child welfare systems: implications for research and practice. Child Abuse Negl 2012, 36:621-32.
• [26]Aarons G: Organizational Climate for Evidence-Based Practice Implementation: Development of a New Scale. Proceedings of the Annual Association for Behavioral and Cognitive Therapies: November 2011; Toronto 2011.
• [27]Antonakis J, Avolio B, Sivasubramaniam N: Context and leadership: an examination of the nine-factor full-range leadership theory using the Multifactor Leadership Questionnaire. Leadership Quart 2003, 14:261-295.
• [28]Aarons GA: Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Ment Health Serv Res 2004, 6:61-74.
• [29]Aarons GA, Sawitzky AC: Organizational culture and climate and mental health provider attitudes towards evidence-based practice. Psychol Serv 2006, 3:61-72.
• [30]Aarons GA: Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child Adolesc Psychiatr Clin N Am 2005, 14:255-271.
• [31]Stumpf RE, Higa-McMillan CK, Chorpita BF: Implementation of evidence-based services for youth: assessing provider knowledge. Behav Modif 2009, 33:48-65.
• [32]Bradley EH, Curry LA, Ramanadhan S, Rowe L, Nembhard I, Krumholz H: Research in action: using positive deviance to improve quality of health care. Implement Sci 2009, 4:25. BioMed Central Full Text
• [33]Palinkas LA, Horwitz SM, Chamberlain P, Hurlburt MS, Landsverk J: Mixed-methods designs in mental health services research: a review. Psychiatr Serv 2011, 62:255-63.
• [34]Guba Y, Lincoln E: Naturalistic Inquiry. Beverly Hills: Sage; 1985.
• [35]Palinkas LA, Aarons GA, Horwitz SM, Chamberlain P, Hurlburt M, Landsverk J: Mixed method designs in implementation research. Adm Policy Ment Health 2011, 38:44-53.
• [36]Creswell JW, Klassen AC, Plano Clark VL: Smith. Best Practices for Mixed Methods Research in the Health Sciences, Rockville: KC; 2011.
• [37]Williams ME, Rogers KC, Carson MC, Sherer S, Hudson BO: Opportunities arising from transformation from treatment as usual to evidence-based practice. Prof Psychol- Res Pr 2011, 43:9-16.
• [38]Schoenwald SK, Garland A, Chapman JE, Frazier S, Sheidow A, Southam-Gerow M: Toward the effective and efficient measurement of implementation fidelity. Adm Policy Ment Health 2011, 38:32-43.