Exploring intensive care nurses’ team performance in a simulation-based emergency situation, − expert raters’ assessments versus self-assessments: an explorative study

BMC Nursing

Marie Louise Hall-Lord²  Birgitta Hedelin²  Mona Persenius¹  Randi Ballangrud² 

[1] Department of Health Sciences, Faculty of Health, Science and Technology, Karlstad University, 651 88, Karlstad, Sweden;Department of Nursing, Faculty of Health, Care and Nursing, Gjøvik University College, Teknologivn. 22, Gjøvik, 2815, Norway

关键词: Team performance;    Simulation-based training;    Patient safety;    Nursing;    Non-technical skills;    Intensive care;    Emergency;    Assessment;   

Others  :  1090425
DOI  :  10.1186/s12912-014-0047-5

 received in 2013-05-09, accepted in 2014-12-09,  发布年份 2014

【 摘 要 】

Background

Effective teamwork has proven to be crucial for providing safe care. The performance of emergencies in general and cardiac arrest situations in particular, has been criticized for primarily focusing on the individual’s technical skills and too little on the teams’ performance of non-technical skills. The aim of the study was to explore intensive care nurses’ team performance in a simulation-based emergency situation by using expert raters’ assessments and nurses’ self-assessments in relation to different intensive care specialties.

Methods

The study used an explorative design based on laboratory high-fidelity simulation. Fifty-three registered nurses, who were allocated into 11 teams representing two intensive care specialties, participated in a videotaped simulation-based cardiac arrest setting. The expert raters used the Ottawa Crisis Resource Management Global Rating Scale and the first part of the Mayo High Performance Teamwork Scale to assess the teams’ performance. The registered nurses used the first part of the Mayo High Performance Teamwork Scale for their self-assessments, and the analyses used were Chi-square tests, Mann–Whitney U tests, Spearman’s rho and Intraclass Correlation Coefficient Type III.

Results

The expert raters assessed the teams’ performance as either advanced novice or competent, with significant differences being found between the teams from different specialties. Significant differences were found between the expert raters’ assessments and the registered nurses’ self-assessments.

Conclusions

Teams of registered nurses representing specialties with coronary patients exhibit a higher competence in non-technical skills compared to team performance regarding a simulated cardiac arrest. The use of expert raters’ assessments and registered nurses’ self-assessments are useful in raising awareness of team performance with regard to patient safety.

【 授权许可】

   
2014 Ballangrud et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Manser T: Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand 2009, 53(2):143-151.
• [2]Buljac-Samardzic M, Dekker-van Doorn CM, Van Wijngaarden JDH, Van Wijk KP: Interventions to improve team effectiveness: a systematic review. Health Policy 2010, 94(3):183-195.
• [3]Manojlovich M, DeCicco B: Healthy work environments, nurse-physician communication, and patients’ outcomes. Am J Crit Care 2007, 16(6):536-543.
• [4]Raemer DB: Team-Oriented Medical Simulation. In Simulators in Critical Care and Beyond. Edited by Dunn WF. Society of Critical Care Medicine, Rochester, Minnesota, USA; 2004:42-46.
• [5]Kohn LT, Corrigan JM, Donaldson MS: To Err is Human: Building a Safer Health System. National Academies press, Washington DC; 2000.
• [6]Gaba DM: The future vision of simulation in health care. Qual Saf Health Care 2004, 13:i2-i10.
• [7]IOM: Crossing the Quality Chasm: a New Health System for the 21st Century. Institute of Medicine. National Academy Press, Washington, D.C; 2001.
• [8]Cato D, Murray M: Use of simulation training in the intensive care unit. Crit Care Nurs Q 2010, 33(1):44-51.
• [9]Nagle BM, McHale JM, Alexander GA, French BM: Incorporating scenario-based simulation into a hospital nursing education program. J Contin Educ Nurs 2009, 40(1):18-25.
• [10]Flin R, O’Connor P, Crichton M: Safety at the Sharp End: A Guide to Non-Technical Skills. Ashgate Publishing Company, Hamphshire, England; 2008.
• [11]Salas E, DiazGranados D, Weaver SJ, King H: Does team training work? principles for health care. Acad Emerg Med 2008, 15(11):1002-1009.
• [12]Flin R, Maran N: Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care 2004, 13(suppl 1):i80-i84.
• [13]Gaba DM, Howard SK, Fish KJ, Smith BE, Sowb YA: Simulation-based training in Anesthesia Crisis Resource Management (ACRM): a decade of experience. Simulat Gaming 2001, 32(2):175-193.
• [14]Flin R, Patey R, Glavin R, Maran N: Anaesthetists’ non-technical skills. Br J Anaesth 2010, 105(1):38-44.
• [15]Rosen MA, Weaver SJ, Lazzara EH, Salas E, Wu T, Silvestri S, Schiebel N, Almeida S, King HB: Tools for evaluating team performance in simulation-based training. J Emerg Trauma Shock 2010, 3(4):353-359.
• [16]Glavin RJ, Maran NJ: Intergration human factors into the medical curricum. Med Educ 2003, 37(s1):59-64.
• [17]Rall M, Dieckmann P: Crisis resoruce management to improve patient safety.Euroanesthesia 2005. Retrieved 20.04.2013, from http://goo.gl/ZH6qcg
• [18]Helmreich RL: On error management: lessons from aviation. Br Med J 2000, 320(7237):781-785.
• [19]Gaba DM, Fish KJ, Howard SK: Crisis Management in Anesthesiology. Churchill Livingstone, New York; 1994.
• [20]Malec JF, Torsher LC, Dunn WF, Wiegmann DA, Arnold JJ, Brown DA, Phatak V: The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simul Healthc 2007, 2(1):4-10.
• [21]Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J: A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa critical care medicine, high-fidelity simulation, and crisis resource management I study. Crit Care Med 2006, 34(8):2167-2174.
• [22]Reader T, Flin R, Lauche K, Cuthbertson BH: Non-technical skills in the intensive care unit. Br J Anaesth 2006, 96(5):551-559.
• [23]Pronovost P, Wu AW, Dorman T, Morlock L: Building safety into ICU care. J Crit Care 2002, 17(2):78-85.
• [24]Pronovost PJ, Thompson DA, Holzmueller CG, Lubomski LH, Dorman T, Dickman F, Fahey M, Steinwachs DM: Toward learning from patient safety reporting systems. J Crit Care 2006, 21(4):305-315.
• [25]Reader TW, Flin R, Mearns K, Cuthbertson BH: Developing a team performance framework for the intensive care unit. Crit Care Med 2009, 37(5):1787-1793.
• [26]Marsch SCU, Müller C, Marquardt K, Conrad G, Tschan F, Hunziker PR: Human factors affect the quality of cardiopulmonary resuscitation in simulated cardiac arrests. Resuscitation 2004, 60(1):51-56.
• [27]Andersen PO, Jensen MK, Lippert A, Østergaard D: Identifying non-technical skills and barriers for improvement of teamwork in cardiac arrest teams. Resuscitation 2010, 81(6):695-702.
• [28]Hunziker S, Johansson AC, Tschan F, Semmer NK, Rock L, Howell MD, Marsch S: Teamwork and leadership in cardiopulmonary resuscitation. J Am Coll Cardiol 2011, 57(24):2381-2388.
• [29]Miller K, Riley W, Davis S: Identifying key nursing and team behaviours to achieve high reliability. J Nurs Manag 2009, 17(2):247-255.
• [30]Rosen MA, Salas E, Wilson KA, King HB, Salisbury M, Augenstein JS, Robinson DW, Birnbach DJ: Measuring team performance in simulation-based training: adopting best practices for healthcare. Simul Healthc 2008, 3(1):33-41.
• [31]Jeffcott SA, Mackenzie CF: Measuring team performance in healthcare: review of research and implications for patient safety. J Crit Care 2008, 23(2):188-196.
• [32]Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence. JAMA 2006, 296(9):1094-1102.
• [33]Arora S, Miskovic D, Hull L, Moorthy K, Aggarwal R, Johannsson H, Gautama S, Kneebone R, Sevdalis N: Self vs expert assessment of technical and non-technical skills in high fidelity simulation. Am J Surg 2011, 202(4):500-506.
• [34]Rall M, Gaba D: Human performance and patient safety. In Millers’s Anesthesia. 6th edition. Edited by Miller RG. Elsevier Churchill Livingstone, Philadephia; 2005:3021-3072.
• [35]Brislin RW: Back-translation for cross-cultural research. J Cross Cult Psychol 1970, 1(3):185-216.
• [36]Northern Nurses Federation: Ethical guidelines for nursing research in the Nordic countries. Retrieved 24.04.2013 from http://www.sykepleien.no/ikbViewer/Content/337889/SSNs%20etiske%20retningslinjer.pdf
• [37]Portney LG, Watkins MP: Foundations of Clinical Research: Applications to Practice. Pearson Prentice Hall, Upper Saddle River; 2009.
• [38]Nelson EC, Batalden PB, Godfrey MM: Quality by Design: a Clinical Microsystems Approach. Jossey-Bass, San Francisco; 2007.
• [39]Jones KJ, Skinner AM, High R, Reiter-Palmon R: A theory-driven, longitudinal evaluation of the impact of team training on safety culture in 24 hospitals. BMJ Qual Saf 2013, 22(5):394-404.
• [40]Quinn T, Thompson D: History and development of coronary care. Intensive Crit Care Nurs 1999, 15(3):131-141.
• [41]Salas E, Burke CS, Stagel KC: Developing teams and team leaders: Strategies and principles. In Leader Development for Transforming Organizations: Growing Leaders for Tomorrow. Edited by Day DV, Zaccaro SJ, Halpin SM. Lawrence Erlbaum, Mahwah, N.J; 2004:325-358.
• [42]Hunziker S, Tschan F, Semmer N, Howell M, Marsch S: Human factors in resuscitation: lessons learned from simulator studies. J Emerg Trauma Shock 2010, 3(4):389-394.
• [43]Künzle B, Kolbe M, Grote G: Ensuring patient safety through effective leadership behaviour: a literature review. Safety Sci 2010, 48(1):1-17.
• [44]Gilligan P, Bhatarcharjee C, Knight G, Smith M, Hegarty D, Shenton A, Todd F, Bradley P: To lead or not to lead? Prospective controlled study of emergency nurses’ provision of advanced life support team leadership. Emerg Med J 2005, 22(9):628-632.
• [45]Marsch SCU, Tschan F, Semmer N, Spychiger M, Breuer M, Hunziker PR: Performance of first responders in simulated cardiac arrests. Crit Care Med 2005, 33(5):963-967.
• [46]Tschan F, Semmer NK, Gautschi D, Hunziker P, Spychiger M, Marsch SU: Leading to recovery: group performance and coordinative activities in medical emergency driven groups. Hum Perform 2006, 19(3):277-304.
• [47]Hunziker S, Tschan F, Semmer N, Zobrist R, Spychiger M, Breuer M, Hunziker P, Marsch S: Hands-on time during cardiopulmonary resuscitation is affected by the process of teambuilding: a prospective randomised simulator-based trial. Emerg Med J 2009, 9(1):3.
• [48]Hancock HC, Easen PR: The decision-making processes of nurses when extubating patients following cardiac surgery: an ethnographic study. Int J Nurs Stud 2006, 43(6):693-706.
• [49]Powell SM, Kimberly Hill R: My copilot is a nurse—using crew resource management in the OR. AORN J 2006, 83(1):178-202.
• [50]Abella BS, Alvarado JP, Myklebust H, Edelson DP, Barry A, O’Hearn N, Vanden Hoek TL, Becker LB: Quality of cardiopulmonary resuscitation during in-hospital cardiac arrest. JAMA 2005, 293(3):305-310.
• [51]Thomas E, Sexton J, Lasky R, Helmreich R, Crandell D, Tyson J: Teamwork and quality during neonatal care in the delivery room. J Perinatol 2006, 26(3):163-169.
• [52]Buckley T, Gordon C: The effectiveness of high fidelity simulation on medical–surgical registered nurses’ ability to recognise and respond to clinical emergencies. Nurse Educ Today 2011, 31(7):716-721.
• [53]France DJ, Greevy RA Jr, Liu X, Burgess H, Dittus RS, Weinger MB, Speroff T: Measuring and comparing safety climate in intensive care units. Med Care 2010, 48(3):279-284.
• [54]Snijders C, Kollen BJ, van Lingen RA, Fetter WPF, Molendijk H: Which aspects of safety culture predict incident reporting behavior in neonatal intensive care units? a multilevel analysis. Crit Care Med 2009, 37(1):61-67.
• [55]Ballangrud R, Hedelin B, Hall-Lord ML: Nurses’ perceptions of patient safety climate in intensive care units: a cross-sectional study. Intensive Crit Care Nurs 2012, 28(6):344-354.
• [56]Salas E, Sims DE, Burke CS: Is there a “big five” in teamwork? Small Group Res 2005, 36(5):555-599.
• [57]JCAHO: Sentinel event data root causes by event type 2004-third quarter 2011. 12-01-2012, from http://www.jointcommission.org/Sentinel_Event_Statistics/
• [58]Leonard M, Graham S, Bonacum D: The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care 2004, 13(suppl 1):i85-i90.
• [59]Kruger J, Dunning D: Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol 1999, 77(6):1121.
• [60]Hodges B, Regehr G, Martin D: Difficulties in recognizing one’s own incompetence: novice physicians who are unskilled and unaware of it. Acad Med 2001, 76(10):S87-S89.
• [61]Doumouras AG, Keshet I, Nathens AB, Ahmed N, Hicks CM: A crisis of faith? A review of simulation in teaching team-based, crisis management skills to surgical trainees. J Surg Educ 2012, 69(3):274-281.