Epidemic features affecting the performance of outbreak detection algorithms

BMC Public Health

Ya Jia Lan²  Zhong Jie Li¹  Ding Lun Zhou²  Wei Zhong Yang¹  Jie Kuang² 

[1] Key Laboratory of Surveillance and Early-warning on Infectious Disease, Chinese Center for Disease Control and Prevention (China CDC), 155 Changbai Road Changping District, Beijing, 102206, China;Department of Occupational Health, West China School of Public Health, Sichuan University, 17 South Section 3 Renmin Road, Chengdu, Sichuan 610041, China

关键词: Automated infectious disease surveillance;    Performance;    Outbreak detection algorithms;    Epidemic feature;   

Others  :  1163557
DOI  :  10.1186/1471-2458-12-418

 received in 2012-01-17, accepted in 2012-06-08,  发布年份 2012

【 摘 要 】

Background

Outbreak detection algorithms play an important role in effective automated surveillance. Although many algorithms have been designed to improve the performance of outbreak detection, few published studies have examined how epidemic features of infectious disease impact on the detection performance of algorithms. This study compared the performance of three outbreak detection algorithms stratified by epidemic features of infectious disease and examined the relationship between epidemic features and performance of outbreak detection algorithms.

Methods

Exponentially weighted moving average (EWMA), cumulative sum (CUSUM) and moving percentile method (MPM) algorithms were applied. We inserted simulated outbreaks into notifiable infectious disease data in China Infectious Disease Automated-alert and Response System (CIDARS), and compared the performance of the three algorithms with optimized parameters at a fixed false alarm rate of 5% classified by epidemic features of infectious disease. Multiple linear regression was adopted to analyse the relationship of the algorithms’ sensitivity and timeliness with the epidemic features of infectious diseases.

Results

The MPM had better detection performance than EWMA and CUSUM through all simulated outbreaks, with or without stratification by epidemic features (incubation period, baseline counts and outbreak magnitude). The epidemic features were associated with both sensitivity and timeliness. Compared with long incubation, short incubation had lower probability (β* = −0.13, P < 0.001) but needed shorter time to detect outbreaks (β* = −0.57, P < 0.001). Lower baseline counts were associated with higher probability (β* = −0.20, P < 0.001) and longer time (β* = 0.14, P < 0.001). The larger outbreak magnitude was correlated with higher probability (β* = 0.55, P < 0.001) and shorter time (β* = −0.23, P < 0.001).

Conclusions

The results of this study suggest that the MPM is a prior algorithm for outbreak detection and differences of epidemic features in detection performance should be considered in automatic surveillance practice.

【 授权许可】

   
2012 Kuang et al.

【 图 表 】

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

【 参考文献 】

• [1]Wang LD, Wang Y, Jin SG, Wu ZY, Chin DP, Koplan JP, Wilson ME: Emergence and control of infectious diseases in China. Lancet 2008, 372(9649):1598-1605.
• [2]Ministry of Health of the People’s Republic of China: Emergency infectious disease prevention and control strategies. Ministry of Health of the People’s Republic of China, Beijing; 2007.
• [3]Yang WZ, Li ZJ, Lan YJ, Wang JF, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ, Liao YL, Hu WB: A nationwide web-based automated system for outbreak early detection and rapid response in China. Western Pacific Surveillance and Response Journal 2011, 2(1):1-6.
• [4]Yang WZ, Lan YJ, Li ZJ, Ma JQ, Jin LM, Sun Q, Lv W, Lai SJ: The application of national outbreak automatic detection and response system, China. Chin J Epidemiol 2010, 31(11):1240-1244.
• [5]Wang L, Ramoni MF, Mandl KD, Sebastiani P: Factors affecting automated syndromic surveillance. Artificial Intelligence in Medicine 2005, 34(3):269-278.
• [6]Buckeridge DL: Outbreak detection through automated surveillance: A review of the determinants of detection. Journal of Biomedical Informatics 2007, 40(4):370-379.
• [7]Wang XL, Zeng D, Seale H, Cheng H, Luan RS, He X, Pang XH, Dou XF, Wang QY: Comparing early outbreak detection algorithms based on their optimized parameter values. Journal of Biomedical Informatics 2010, 43(1):97-103.
• [8]Pelecanos AM, Ryan PA, Gatton ML: Outbreak detection algorithms for seasonal disease data: a case study using ross river virus disease. BMC Med Inform Decis Mak 2010, 10:74. BioMed Central Full Text
• [9]Watkins RE, Eagleson S, Veenendaal B, Wright G, Plant AJ: Disease surveillance using a hidden Markov model. BMC Med Inform Decis Mak 2009, 9:39. BioMed Central Full Text
• [10]Jiang X, Cooper GF: A real-time temporal Bayesian architecture for event surveillance and its application to patient-specific multiple disease outbreak detection. Data Mining and Knowledge Discovery 2010, 20(3):328-360.
• [11]Lu HM, Zeng D, Chen HC: Prospective Infectious Disease Outbreak Detection Using Markov Switching Models. Ieee Transactions on Knowledge and Data Engineering 2010, 22(4):565-577.
• [12]Shen Y, Cooper GF: A New Prior for Bayesian Anomaly Detection Application to Biosurveillance. Methods of Information in Medicine 2010, 49(1):44-53.
• [13]Alimadad A, Salibian-Barrera M: An Outlier-Robust Fit for Generalized Additive Models With Applications to Disease Outbreak Detection. Journal of the American Statistical Association 2011, 106(494):719-731.
• [14]Jiang FJ: Evaluation research on the quality of reporting in Emergency Public Reporting System. Master thesis. Chinese Center for Disease Control and Prevention. 2006.
• [15]Stroup DF, Williamson GD, Herndon JL, Karon JM: Detection of aberrations in the occurrence of notifiable diseases surveillance data. Statistics in Medicine 1989, 8:323-329.
• [16]Farrington CP, Andrews NJ, Beale AD, Catchpole MA: A statistical algorithm for the early detection of outbreaks of infectious disease. Journal of the Royal Statistical Society, Series A 1996, 159:547-563.
• [17]Williamson GD, Hudson GW: A monitoring system for detecting aberrations in public health surveillance reports. Statistics in Medicine 1999, 18:3283-3298.
• [18]Reis BY, Mandl KD: Time series modeling for syndromic surveillance. BMC Med Inform Decis Mak 2003, 3:2. BioMed Central Full Text
• [19]Zhang J, Tsui FC, Wagner MM, Hogan WR: Detection of Outbreaks from Time Series Data Using Wavelet Transform. AMIA Annu Symp Proc 2003, 748-752.
• [20]Montgomery DC: Introduction to Statistical Quality Control. John Wiley and Sons, New York; 2001.
• [21]Hutwagner LC, Maloney EK, Bean NH, Slutsker L, Martin SM: Using laboratory-based surveillance data for prevention: an algorithm for detecting salmonella outbreaks. Emerg Infect Dis 1997, 3:395-400.
• [22]Yang WZ, Xing HX, Wang HZ, Lan YJ, Sun Q, Hu SX, Lv W, Yuan ZA, Chen YX, Dong BQ: A study on early detection for seven infectious diseases. Chin J Epidemiol 2004, 25(12):1039-1041.
• [23]R Development Core Team: [http://www.R-project.org] webciteR: A language and environment for statistical computing.
• [24]Zhang RJ, Ji GH, Wang Y, Zai B: Investigation of a Shigella bacteria cause bacillary dysentery outbreak. Chin J Pest Control 2009, 25(6):437-438.
• [25]Li SX, Li LJ, Yu QF, Yu FB, Yu HX, Wu BW: Investigation of a scarlet fever outbreak in a school, Yuxi City. Chin J Sch Health 2005, 26(6):510-511.
• [26]Zhang TT, Chen HX: Analysis of a mumps outbreak in a junior middle school of Huaxi town, Huayin City. Henan Journal of Preventive Medicine 2009, 20(6):449-450.
• [27]Huo HC: Report on a measles outbreak investigation. Disease surveillance 1997, 11:430.
• [28]Yao LJ, Chen HH: Analysis of a malaria outbreak investigation. Guangdong health and epidemic prevention 1998, 24(1):43-44.
• [29]Yin K, Li MQ, Liu JJ: Analysis of typhoid outbreak investigation in a school, Liuzhou. Modern preventive medicine 2007, 34(13):2559-2560.
• [30]Chen ZZ: A outbreak investigation of encephalitis B in 2000 year, Anxi County. Journal of Preventive Medicine Information 2001, 17(4):278-279.
• [31]Nong ZM, Meng LJ, Liu ZH, Jiang CH: Investigation of a hepatitis A outbreak in a school. Chin J Sch Health 2009, 30(3):274-275.
• [32]Ma YL: Infectious diseases. Shanghai scientific & Technical Publishers, Shanghai; 2004.
• [33]Wagner MM, Wallstrom G: Methods For Algorithm Evaluation. In Handbook of Biosurveillance. Edited by Wagner MM, Moore AW, Aryel RM. Elsevier Press, Burlington; 2006:301-310.
• [34]Nordin JD, Goodman MJ, Kulldorff M, Ritzwoller DP, Abrams AM, Kleinman K, Levitt MJ, Donahue J, Platt R: Simulated anthrax attacks and syndromic surveillance. Emerg Infect Dis 2005, 11(9):1396-1400.
• [35]Ozonoff A, Forsberg L, Bonetti M, Pagano M: Bivariate method for spatio-temporal syndromic surveillance. MMWR Morb Mortal Wkly Rep 2004, 53(Suppl):59-66.
• [36]Jackson ML, Baer A, Painter I, Duchin J: A simulation study comparing aberration detection algorithms for syndromic surveillance. BMC Med Inform Decis Mak 2000, 7:6.
• [37]Hutwagner L, Browne T, Seeman GM, Fleischauer AT: Comparing aberration detection methods with simulated data. Emerg Infect Dis 2005, 11:314-316.
• [38]Goldenberg A, Shmueli G, Caruana RA, Fienberg SE: Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales. Proc Natl Acad Sci USA 2002, 99(8):5237-5240.
• [39]Reis BY, Pagano M, Mandl KD: Using temporal context to improve biosurveillance. Proc Natl Acad Sci USA 2003, 100(4):1961-1965.