Prevalence dependent calibration of a predictive model for nasal carriage of methicillin-resistant Staphylococcus aureus

BMC Infectious Diseases

Ulrich Vogel⁷  Matthias Frosch⁷  Christian Wunder¹  Christoph Weisser^1,10  Wolfgang Müllges⁶  Hubertus Riedmiller³  Annette Kolb-Mäurer⁵  Sebastian Maier²  Hartmut Boehm⁸  Frithjof Eckhardt⁹  Corinna Schmitt^1,11  Peter U Heuschmann⁴  Johannes Elias⁷ 

[1] Department of Anesthesiology, University Hospital Würzburg, Oberduerrbacher Strasse 6, Würzburg, 97080, Germany;Department of Medicine I, University Hospital Würzburg, Oberduerrbacher Strasse 6, Würzburg, 97080, Germany;Department of Urology and Paediatric Urology, University Hospital Würzburg, Oberduerrbacher Strasse 6, Würzburg, 97080, Germany;Institute for Clinical Epidemiology and Biometrics, University of Würzburg; Center for Clinical Studies, University Hospital Würzburg, Josef Schneider-Strasse 2, Würzburg, 97080, Germany;Department of Dermatology, University Hospital Würzburg, Josef Schneider-Strasse 2, Würzburg, 97080, Germany;Department of Neurology, University Hospital Würzburg, Josef Schneider-Strasse 11, Würzburg, 97080, Germany;Institute for Hygiene and Microbiology, University of Würzburg, Josef Schneider-Strasse 2, Würzburg, 97080, Germany;Department of Maxillofacial Surgery, University Hospital Würzburg, Pleicherwall 2, Würzburg, 97070, Germany;Service Center for Medical Informatics, University Hospital Würzburg, Josef Schneider-Strasse 2, Würzburg, 97080, Germany;Department of Sugery II, University Hospital Würzburg, Oberduerrbacher Strasse 6, Würzburg, 97080, Germany;Present address: Hannover Medical School, Institute of Virology, Carl Neuberg-Strasse 1, Hannover, 30625, Germany

关键词: Calibration;    False positive reactions;    Predictive value of tests;    Clinical prediction rule;    Infection control;    Methicillin-resistant staphylococcus aureus;   

Others  :  1171012
DOI  :  10.1186/1471-2334-13-111

 received in 2012-09-20, accepted in 2013-02-18,  发布年份 2013

【 摘 要 】

Background

Published models predicting nasal colonization with Methicillin-resistant Staphylococcus aureus among hospital admissions predominantly focus on separation of carriers from non-carriers and are frequently evaluated using measures of discrimination. In contrast, accurate estimation of carriage probability, which may inform decisions regarding treatment and infection control, is rarely assessed. Furthermore, no published models adjust for MRSA prevalence.

Methods

Using logistic regression, a scoring system (values from 0 to 200) predicting nasal carriage of MRSA was created using a derivation cohort of 3091 individuals admitted to a European tertiary referral center between July 2007 and March 2008. The expected positive predictive value of a rapid diagnostic test (GeneOhm, Becton & Dickinson Co.) was modeled using non-linear regression according to score. Models were validated on a second cohort from the same hospital consisting of 2043 patients admitted between August 2008 and January 2012. Our suggested correction score for prevalence was proportional to the log-transformed odds ratio between cohorts. Calibration before and after correction, i.e. accurate classification into arbitrary strata, was assessed with the Hosmer-Lemeshow-Test.

Results

Treating culture as reference, the rapid diagnostic test had positive predictive values of 64.8% and 54.0% in derivation and internal validation corhorts with prevalences of 2.3% and 1.7%, respectively. In addition to low prevalence, low positive predictive values were due to high proportion (> 66%) of mecA-negative Staphylococcus aureus among false positive results. Age, nursing home residence, admission through the medical emergency department, and ICD-10-GM admission diagnoses starting with “A” or “J” were associated with MRSA carriage and were thus included in the scoring system, which showed good calibration in predicting probability of carriage and the rapid diagnostic test’s expected positive predictive value. Calibration for both probability of carriage and expected positive predictive value in the internal validation cohort was improved by applying the correction score.

Conclusions

Given a set of patient parameters, the presented models accurately predict a) probability of nasal carriage of MRSA and b) a rapid diagnostic test’s expected positive predictive value. While the former can inform decisions regarding empiric antibiotic treatment and infection control, the latter can influence choice of screening method.

【 授权许可】

   
2013 Elias et al; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

【 参考文献 】

• [1]Cosgrove SE, Qi Y, Kaye KS, Harbarth S, Karchmer AW, Carmeli Y: The impact of methicillin resistance in staphylococcus aureus bacteremia on patient outcomes: mortality, length of stay, and hospital charges. Infect Control Hosp Epidemiol 2005, 26:166-174.
• [2]Shurland S, Zhan M, Bradham DD, Roghmann M: Comparison of mortality risk associated with bacteremia Due to methicillin‐resistant and methicillin‐susceptible staphylococcus aureus. Infect Control Hosp Epidemiol 2007, 28:273-279.
• [3]Vidaur L, Planas K, Sierra R, Dimopoulos G, Ramirez A, Lisboa T, Rello J: Ventilator-associated pneumonia: impact of organisms on clinical resolution and medical resources utilization. Chest 2008, 133:625-632.
• [4]Köck R, Becker K, Cookson B, Van Gemert-Pijnen JE, Harbarth S, Kluytmans J, Mielke M, Peters G, Skov RL, Struelens MJ, Tacconelli E, Navarro Torné A, Witte W, Friedrich AW: Methicillin-resistant Staphylococcus aureus (MRSA): burden of disease and control challenges in Europe. Euro Surveill 2010, 15:19688.
• [5]Klevens RM, Morrison MA, Nadle J, Petit S, Gershman K, Ray S, Harrison LH, Lynfield R, Dumyati G, Townes JM, Craig AS, Zell ER, Fosheim GE, McDougal LK, Carey RB, Fridkin SK, For the Active Bacterial Core surveillance (ABCs) MRSA Investigators: Invasive methicillin-resistant staphylococcus aureus infections in the United States. JAMA 2007, 298:1763-1771.
• [6]Bootsma MCJ, Diekmann O, Bonten MJM: Controlling methicillin-resistant staphylococcus aureus: quantifying the effects of interventions and rapid diagnostic testing. Proc Natl Acad Sci 2006, 103:5620-5625.
• [7]Liebowitz LD: MRSA burden and interventions. Int J Antimicrob Agents 2009, 34:S11-S13.
• [8]Health Council of the Netherlands: MRSA policy in the Netherlands. The Hague: Health Council of the Netherlands; 2007.
• [9]Screening for Meticillin-resistant Staphylococcus aureus (MRSA) colonisation: a strategy for NHS trusts - a summary of best practice. http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_063188 webcite
• [10]Tacconelli E, De Angelis G, De Waure C, Cataldo MA, Torre GL, Cauda R: Rapid screening tests for meticillin-resistant Staphylococcus aureus at hospital admission: systematic review and meta-analysis. Lancet Infect Dis 2009, 9:546-554.
• [11]Robicsek A, Beaumont JL, Wright M, Thomson J, Kaul KL, Peterson LR: Electronic prediction rules for methicillin‐resistant staphylococcus aureus colonization. Infect Control Hosp Epidemiol 2011, 32:9-19.
• [12]Harbarth S, Huttner B, Gervaz P, Fankhauser C, Chraiti M-N, Schrenzel J, Licker M, Pittet D: Risk factors for methicillin-resistant staphylococcus aureus surgical site infection. Infect Control Hosp Epidemiol 2008, 29:890-893.
• [13]Sax H, Harbarth S, Gavazzi G, Henry N, Schrenzel J, Rohner P, Michel JP, Pittet D: Prevalence and prediction of previously unknown MRSA carriage on admission to a geriatric hospital. Age Ageing 2005, 34:456-462.
• [14]Harbarth S, Sax H, Fankhauser-Rodriguez C, Schrenzel J, Agostinho A, Pittet D: Evaluating the probability of previously unknown carriage of MRSA at hospital admission. Am J Med 2006, 119:275.e15-275.e23.
• [15]Harbarth S, Hawkey PM, Tenover F, Stefani S, Pantosti A, Struelens MJ: Update on screening and clinical diagnosis of meticillin-resistant Staphylococcus aureus (MRSA). Int J Antimicrob Agents 2011, 37:110-117.
• [16]Nulens E, Descheemaeker P, Deurenberg RH, Stobberingh EE, Gordts B: Contribution of two molecular assays as compared to selective culture for MRSA screening in a low MRSA prevalence population. Infection 2010, 38:98-101.
• [17]Conterno LO, Shymanski J, Ramotar K, Toye B, Van Walraven C, Coyle D, Roth VR: Real‐time polymerase chain reaction detection of methicillin‐resistant staphylococcus aureus: impact on nosocomial transmission and costs. Infect Control Hosp Epidemiol 2007, 28:1134-1141.
• [18]Gray J, Patel M, Turner H, Reynolds F: MRSA screening on a paediatric intensive care unit. Arch Dis Child 2012, 97:243-244.
• [19]Robert Koch Institut: Kommentar zu den “Empfehlungen zur Prävention und Kontrolle von Methicillin-resistenten Staphylococcus aureus-Stämmen in Krankenhäusern und anderen Medizinischen Einrichtungen”. Epidemiologisches Bulletin 2004, 46:396.
• [20]Jonas D, Speck M, Daschner FD, Grundmann H: Rapid PCR-based identification of methicillin-resistant staphylococcus aureus from screening swabs. J Clin Microbiol 2002, 40:1821-1823.
• [21]R: A Language and Environment for Statistical Computing. http://www.R-project.org/ webcite
• [22]rms: Regression Modeling Strategies. http://cran.r-project.org/web/packages/rms/index.html webcite
• [23]Hosmer DW, Lemeshow S: A goodness-of-fit test for the multiple logistic regression model. Comm Stat Theor Meth 1980, 9:1043-1069.
• [24]Cook NR: Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007, 115:928-935.
• [25]De Backer G, Ambrosioni E, Borch-Johnsen K, Brotons C, Cifkova R, Dallongeville J, Ebrahim S, Faergeman O, Graham I, Mancia G, Cats VM, Orth-Gomér K, Perk J, Pyörälä K, Rodicio JL, Sans S, Sansoy V, Sechtem U, Silber S, Thomsen T, Wood D: European guidelines on cardiovascular disease prevention in clinical practice: third joint task force of European and other societies on cardiovascular disease prevention in clinical practice (constituted by representatives of eight societies and by invited experts). Eur J Cardiovasc Prev Rehabil 2003, 10:S1-S10.
• [26]Hidron AI, Kourbatova EV, Halvosa JS, Terrell BJ, McDougal LK, Tenover FC, Blumberg HM, King MD: Risk factors for colonization with methicillin‐resistant staphylococcus aureus (MRSA) in patients admitted to an urban hospital: emergence of community‐associated MRSA nasal carriage. Clin Infect Dis 2005, 41:159-166.
• [27]Riedel S, Stein DV, Richardson K, Page J, Miller S, Winokur P, Diekema D: Development of a prediction rule for methicillin‐resistant staphylococcus aureus and vancomycin‐resistant Enterococcus carriage in a veterans affairs medical center population. Infect Control Hosp Epidemiol 2008, 29:969-971.
• [28]Gopal Rao G, Michalczyk P, Nayeem N, Walker G, Wigmore L: Prevalence and risk factors for meticillin-resistant Staphylococcus aureus in adult emergency admissions - a case for screening all patients? J Hosp Infect 2007, 66:15-21.
• [29]Harbarth S, Sax H, Uckay I, Fankhauser C, Agostinho A, Christenson JT, Renzi G, Schrenzel J, Pittet D: A predictive model for identifying surgical patients at risk of methicillin-resistant staphylococcus aureus carriage on admission. J Am Coll Surg 2008, 207:683-689.
• [30]Diller R, Sonntag AK, Mellmann A, Grevener K, Senninger N, Kipp F, Friedrich AW: Evidence for cost reduction based on pre-admission MRSA screening in general surgery. Int J Hyg Environ Heal 2008, 211:205-212.
• [31]Casas I, Sopena N, Esteve M, Quesada MD, Andrés I, Matas L, Blanco S, Pedro-Botet ML, Caraballo M, Ausina V, Sabrià M: Prevalence of and risk factors for methicillin‐resistant staphylococcus aureus carriage at hospital admission. Infect Control Hosp Epidemiol 2007, 28:1314-1317.
• [32]Lucet J-C, Chevret S, Durand-Zaleski I, Chastang C, Regnier B, For the Multicenter Study Group: Prevalence and risk factors for carriage of methicillin-resistant staphylococcus aureus at admission to the intensive care unit: results of a multicenter study. Arch Intern Med 2003, 163:181-188.
• [33]Santos H, Machado D, Camey S, Kuchenbecker R, Barth A, Wagner M: Prevalence and acquisition of MRSA amongst patients admitted to a tertiary-care hospital in brazil. BMC Infect Dis 2010, 10:328. BioMed Central Full Text
• [34]Jernigan JA, Pullen AL, Flowers L, Jarvis WR, Bell M: Prevalence of and risk factors for colonization with methicillin‐resistant staphylococcus aureus at the time of hospital admission. Infect Control Hosp Epidemiol 2003, 24:409-414.
• [35]Haley CC, Mittal D, LaViolette A, Jannapureddy S, Parvez N, Haley RW: Methicillin-resistant staphylococcus aureus infection or colonization present at hospital admission: multivariable risk factor screening to increase efficiency of surveillance culturing. J Clin Microbiol 2007, 45:3031-3038.
• [36]Muralidhar B, Anwar SM, Handa AI, Peto TEA, Bowler ICJW: Prevalence of MRSA in emergency and elective patients admitted to a vascular surgical unit: implications for antibiotic prophylaxis. Eur J Vasc Endovasc Surg 2006, 32:402-407.
• [37]Hense H-W, Koesters E, Wellmann J, Meisinger C, Völzke H, Keil U: Evaluation of a recalibrated systematic coronary risk evaluation cardiovascular risk chart: results from systematic coronary risk evaluation Germany. Eur J Cardiovasc Prev Rehabil 2008, 15:409-415.
• [38]Wolk DM, Picton E, Johnson D, Davis T, Pancholi P, Ginocchio CC, Finegold S, Welch DF, De Boer M, Fuller D, Solomon MC, Rogers B, Mehta MS, Peterson LR: Multicenter evaluation of the Cepheid xpert methicillin-resistant staphylococcus aureus (MRSA) test as a rapid screening method for detection of MRSA in nares. J Clin Microbiol 2009, 47:758-764.