Provider REport of Sustainment Scale (PRESS): development and validation of a brief measure of inner context sustainment

Implementation Science

Gregory A. Aarons¹  Marisa Sklar¹  Amy Green²  Mark G. Ehrhart³  Joanna C. Moullin⁴ 

[1] Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, 92123, San Diego, CA, USA;Department of Psychiatry, University of California San Diego, 9500 Gilman Drive (0812), 92093-0812, La Jolla, CA, USA;UC San Diego ACTRI Dissemination and Implementation Science Center (UC San Diego ACTRI DISC), Altman Clinical and Translational Research Institute (ACTRI), 9500 Gilman Drive (0990), 92093-0990, La Jolla, CA, USA;Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, 92123, San Diego, CA, USA;The Trevor Project, PO Box 69232, 90069, West Hollywood, CA, USA;Department of Psychology, University of Central Florida, PO Box 161390, 32816-1390, Orlando, FL, USA;Faculty of Health Sciences, Curtin Medical School, Curtin University, Kent Street, Bentley, 6102, Perth, Western Australia, Australia;Child and Adolescent Services Research Center, 3665 Kearny Villa Rd., Suite 200N, 92123, San Diego, CA, USA;

关键词: Sustainment;    Sustainability;    Maintenance;    Implementation;    Measurement;    Scale;    Psychometric properties;    Knowledge translation;   

DOI  :  10.1186/s13012-021-01152-w

来源: Springer

【 摘 要 】

BackgroundImplementation scientists and practitioners often rely on frontline providers for reporting on implementation outcomes. Furthermore, measures of sustainment are few, and available sustainment measures are mainly setting or evidenced-based practice (EBP) specific, require organizational and system-level knowledge to complete, and often lack psychometric rigor. The aim of this study was to develop a brief, pragmatic, and generalizable measure for completion by frontline service providers of the implementation outcome, sustainment.MethodsWe utilized a Rasch measurement theory approach to scale the development and testing of psychometric parameters. Sustainment items were developed to be relevant for direct service providers to complete. In order to promote generalizability, data were collected and items were tested across four diverse psychosocial evidence-based practices (motivational interviewing [MI], SafeCare®, classroom pivotal response training [CPRT], and an individualized mental health intervention for children with autism spectrum disorder [AIM-HI]) and in four service settings (substance use disorder treatment, child welfare, education, and specialty mental health). Associations between the sustainment measure and sustainment leadership, sustainment climate, and attitudes towards the adoption and use of each of the EBPs were assessed to confirm construct validity.ResultsThree items for the Provider REport of Sustainment Scale (PRESS) were assessed for measuring the core component of sustainment: continued use of the EBP. Internal consistency reliability was high. The scale indicated fit to the Rasch measurement model with no response dependency, ordered thresholds, no differential item functioning, and supported unidimensionality. Additionally, construct validity evidence was provided based on the correlations with related variables.ConclusionThe PRESS measure is a brief, three-item measure of sustainment that is both pragmatic and useable across different EBPs, provider types, and settings. The PRESS captures frontline staffs’ report of their clinic, team, or agency’s continued use of an EBP. Future testing of the PRESS for concurrent and predictive validity is recommended.

【 授权许可】

CC BY