Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS)

Implementation Science

Lauren R Farahnak¹  Gregory A Aarons¹  Mark G Ehrhart² 

[1] Child and Adolescent Services Research Center, San Diego, CA, USA;Department of Psychology, San Diego State University, San Diego, CA, USA

关键词: Mental health;    Measurement;    Organizational context;    Evidence-based practice;    Organizational citizenship behavior;    Implementation citizenship behavior;   

Others  :  1218378
DOI  :  10.1186/s13012-015-0255-8

 received in 2014-11-21, accepted in 2015-04-22,  发布年份 2015

【 摘 要 】

Background

In line with recent research on the role of the inner context of organizations in implementation effectiveness, this study extends research on organizational citizenship behavior (OCB) to the domain of evidence-based practice (EBP) implementation. OCB encompasses those behaviors that go beyond what is required for a given job that contribute to greater organizational effectiveness. The goal of this study was to develop and test a measure of implementation citizenship behavior (ICB) or those behaviors that employees perform that go above and beyond what is required in order to support EBP implementation.

Methods

The primary participants were 68 supervisors from ten mental health agencies throughout California. Items measuring ICB were developed based on past research on OCB and in consultation with experts on EBP implementation in mental health settings. Supervisors rated 357 of their subordinates on ICB and implementation success. In addition, 292 of the subordinates provided data on self-rated performance, attitudes towards EBPs, work experience, and full-time status. The supervisor sample was randomly split, with half used for exploratory factor analyses and the other half for confirmatory factor analyses. The entire sample of supervisors and subordinates was utilized for analyses assessing the reliability and construct validity of the measure.

Results

Exploratory factor analyses supported the proposed two-factor structure of the Implementation Citizenship Behavior Scale (ICBS): (1) Helping Others and (2) Keeping Informed. Confirmatory factor analyses with the other half of the sample supported the factor structure. Additional analyses supported the reliability and construct validity for the ICBS.

Conclusions

The ICBS is a pragmatic brief measure (six items) that captures critical behaviors employees perform to go above and beyond the call of duty to support EBP implementation, including helping their fellow employees on implementation-related activities and keeping informed about issues related to EBP and implementation efforts. The ICBS can be used by researchers to better understand the outcomes of improved organizational support for implementation (i.e., implementation climate) and the proximal predictors of implementation effectiveness. The ICBS can also provide insight for organizations, practitioners, and managers by focusing on key employee behaviors that should increase the probability of implementation success.

【 授权许可】

   
2015 Ehrhart et al.

【 参考文献 】

• [1]Organ DW, Podsakoff PM, MacKenzie SB. Organizational citizenship behavior: its nature, antecedents, and consequences. Sage Publications, Thousand Oaks, CA; 2006.
• [2]Nielsen TM, Hrivnak GA, Shaw M. Organizational citizenship behavior and performance: a meta-analysis of group-level research. Small Gr Res. 2009; 40:555-77.
• [3]Podsakoff PM, MacKenzie SB. Impact of organizational citizenship behavior on organizational performance: a review and suggestions for future research. Hum Perform. 1997; 10:133-51.
• [4]Podsakoff NP, Whiting SW, Podsakoff PM, Blume BD. Individual- and organizational-level consequences of organizational citizenship behaviors: a meta-analysis. J Appl Psychol. 2009; 94:122-41.
• [5]MacKenzie SB, Podsakoff PM, Fetter R. Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons’ performance. Organ Behav Hum Decis Process. 1991; 50:123-50.
• [6]MacKenzie SB, Podsakoff PM, Fetter R. The impact of organizational citizenship behavior on evaluations of salesperson performance. J Mark Ment Health. 1993; 57:70-80.
• [7]Piercy NF, Cravens DW, Lane N. Sales manager behavior-based control and salesperson performance: the effects of manager control competencies and organizational citizenship behavior. J Mark Theory Pract. 2012; 20:7-22.
• [8]Walz SM, Niehoff BP. Organizational citizenship behaviors: their relationship to organizational effectiveness. J Hosp To. 2000; 24:301-19.
• [9]Podsakoff PM, MacKenzie SB. Organizational citizenship behaviors and sales unit effectiveness. J Mark Res. 1994; 31:351-63.
• [10]Podsakoff PM, Ahearne M, MacKenzie SB. Organizational citizenship behavior and the quantity and quality of work group performance. J Appl Psychol. 1997; 82:262-70.
• [11]Chen CH, Wang SJ, Chang WC, Hu CS. The effect of leader-member exchange, trust, and supervisor support on organizational citizenship behavior in nurses. J Nurs Res. 2008; 16:321-8.
• [12]Chien CC, Chou HK, Hung ST. A conceptual model of nurses’ goal orientation, service behavior, and service performance. Nurs Econ. 2008; 26:374-83.
• [13]Cohen A, Kol Y. Professionalism and organizational citizenship behavior: an empirical examination among Israeli nurses. J Manage Psychol. 2004; 19:386-405.
• [14]Kalisch BJ, Curley M, Stefanov S. An intervention to enhance nursing staff teamwork and engagement. J Nurs Adm. 2007; 37:77-84.
• [15]Bettencourt LA, Brown SW. Contact employees: relationships among workplace fairness, job satisfaction and prosocial service behaviors. J Retailing. 1997; 73:39-61.
• [16]Schneider B, Ehrhart MG, Mayer DM, Saltz JL, Niles-Jolly K. Understanding organization-customer links in service settings. Acad Manage J. 2005; 48:1017-32.
• [17]Griffin MA, Neal A. Perceptions of safety at work: a framework for linking safety climate to safety performance, knowledge, and motivation. J Occup Health Psychol. 2000; 5:347-58.
• [18]Cree T, Kelloway KE. Responses to occupational hazards: exit and participation. J Occup Health Psychol. 1997; 2:304-11.
• [19]Mullen J. Testing a model of employee willingness to raise safety issues. Can J Behav Sc. 2005; 37:273-82.
• [20]Sackett DL, Straus SE, Richardson WS, Rosenberg WM, Haynes RB. Evidence-based medicine: how to practice and teach EBM. 2nd ed. Churchill Livingstone, New York; 2000.
• [21]Dissemination and implementation of evidence-based practices in child and adolescent mental health. Oxford University Press, Oxford, UK; 2014.
• [22]Lobb R, Colditz GA. Implementation science and its application to population health. Annu Rev Public Health. 2013; 34:235-51.
• [23]Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Hlth. 2011; 38:4-23.
• [24]Williams NJ, Glisson C. The role of organizational culture and climate in the dissemination and implementation of empirically supported treatments for youth. In: Dissemination and implementation of evidence-based practices in child and adolescent mental health. Beidas RS, Kendall P, editors. Oxford University Press, Oxford, UK; 2014: p.61-81.
• [25]Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014; 9:45. BioMed Central Full Text
• [26]Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014; 9:157. BioMed Central Full Text
• [27]Jacobs SR, Weiner BJ, Bunger AC. Context matters: measuring implementation climate among individuals and groups. Implement Sci. 2014; 9:46. BioMed Central Full Text
• [28]Glisson C, Landsverk J, Schoenwald S, Kelleher K, Hoagwood K, Mayberg S et al.. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research Special Issue: Improving mental health services. 2008; 35:98-113.
• [29]Soumerai SB, McLaughlin TJ, Gurwitz JH, Guadagnoli E, Hauptman PJ, Borbas C et al.. Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. JAMA. 1998; 279:1358-63.
• [30]Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004; 82:581-629.
• [31]Glisson C, Schoenwald S. The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Ment Health Serv Res. 2005; 7:243-59.
• [32]Damschroder L, Aron D, Keith R, Kirsh S, Alexander J, Lowery J. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009; 4:50-64. BioMed Central Full Text
• [33]Williams LJ, Anderson SE. Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. J Air Waste Manage Assoc. 1991; 17:601-17.
• [34]Organ DW, Ryan K. A meta-analytic review of attitudinal and dispositional predictors of organizational citizenship behavior. Pers Psychol. 1995; 48:775-802.
• [35]Morrison EW, Vancouver JB. Within-person analysis of information seeking: the effects of perceived costs and benefits. J Air Waste Manage Assoc. 2000; 26:119-37.
• [36]Sosna T, Marsenich L. Community development team model: supporting the model adherent implementation of programs and practices. California Institute for Mental Health, Sacramento; 2006.
• [37]Hofmann DA, Morgeson FP, Gerras SJ. Climate as a moderator of the relationship between leader-member exchange and content specific citizenship: safety climate as an exemplar. J Appl Psychol. 2003; 88:170-8.
• [38]Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004; 6:61-74.
• [39]Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and United States national norms of the evidence-based practice attitude scale (EBPAS). Psychol Assessment. 2010; 22:356-65.
• [40]Muthén LK, Muthén BO. Mplus user’s guide. 7th ed. Muthén & Muthén, Los Angeles, CA; 2012.
• [41]Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965; 30:179-85.
• [42]Patil VH, Singh SN, Mishra S, Donavan DT. Efficient theory development and factor retention criteria: a case for abandoning the ‘eigenvalue greater than one’ criterion. J Bus Res. 2008; 61:162-70.
• [43]Zwick WR, Velicer WF. Comparison of five rules for determining the number of components to retain. Psychol Bull. 1986; 99:432-42.
• [44]Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999; 4:272-99.
• [45]Hu L-T, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999; 6:1-55.
• [46]Guo Q, Li F, Chen X, Wang W, Meng Q. Performance of fit indices in different conditions and selection of cut-off values. Acta Psychol Sinica. 2008; 40:109-18.
• [47]Heilman ME, Chen JJ. Same behavior, different consequences: reactions to women’s altruistic citizenship behavior. J Appl Psychol. 2005; 90:431-41.
• [48]McAllister DJ, Kamdar D, Morrison EW, Turban DB. Disentangling role perceptions: how perceived role breadth, discretion, instrumentality, and efficacy relate to helping and taking charge. J Appl Psychol. 2007; 92:1200-11.
• [49]Morrison EW. Role definitions and organizational citizenship behavior: The importance of the employee’s perspective. Acad Manage J. 1994; 37:1543-67.
• [50]MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychol Methods. 1999; 4:84-99.