The pot calling the kettle black: the extent and type of errors in a computerized immunization registry and by parent report

BMC Pediatrics

Richard P Golonka¹  Donald P Schopflocher³  Shannon E MacDonald² 

[1] Alberta Health Services, Health Protection, Communicable Disease Control, Main Floor, West Tower Coronation Plaza, 14310-111 Ave, Edmonton, Alberta T5M 3Z7, Canada;Faculty of Nursing, University of Alberta, Level 3, Edmonton Clinic Health Academy, 11405-87 Ave, Edmonton, Alberta T6G 1C9, Canada;School of Public Health, University of Alberta, 3–300 Edmonton Clinic Health Academy, 11405- 87 Ave, Edmonton, Alberta T6G 1C9, Canada

关键词: Misclassification;    Parent report;    Registry;    Immunization information system (IIS);    Immunization status;    Vaccination;    Immunization;   

Others  :  1090695
DOI  :  10.1186/1471-2431-14-1

 received in 2013-10-02, accepted in 2013-12-27,  发布年份 2014

【 摘 要 】

Background

Accurate classification of children’s immunization status is essential for clinical care, administration and evaluation of immunization programs, and vaccine program research. Computerized immunization registries have been proposed as a valuable alternative to provider paper records or parent report, but there is a need to better understand the challenges associated with their use. This study assessed the accuracy of immunization status classification in an immunization registry as compared to parent report and determined the number and type of errors occurring in both sources.

Methods

This study was a sub-analysis of a larger study which compared the characteristics of children whose immunizations were up to date (UTD) at two years as compared to those not UTD. Children’s immunization status was initially determined from a population-based immunization registry, and then compared to parent report of immunization status, as reported in a postal survey. Discrepancies between the two sources were adjudicated by review of immunization providers’ hard-copy clinic records. Descriptive analyses included calculating proportions and confidence intervals for errors in classification and reporting of the type and frequency of errors.

Results

Among the 461 survey respondents, there were 60 discrepancies in immunization status. The majority of errors were due to parent report (n = 44), but the registry was not without fault (n = 16). Parents tended to erroneously report their child as UTD, whereas the registry was more likely to wrongly classify children as not UTD. Reasons for registry errors included failure to account for varicella disease history, variable number of doses required due to age at series initiation, and doses administered out of the region.

Conclusions

These results confirm that parent report is often flawed, but also identify that registries are prone to misclassification of immunization status. Immunization program administrators and researchers need to institute measures to identify and reduce misclassification, in order for registries to play an effective role in the control of vaccine-preventable disease.

【 授权许可】

   
2014 MacDonald et al.; licensee BioMed Central Ltd.

【 参考文献 】

• [1]Placzek H, Madoff LC: The use of immunization registry-based data in vaccine effectiveness studies. Vaccine 2011, 29:399-411.
• [2]Greene SK, Shi P, Dutta-Linn MM, Shoup JA, Hinrichsen VL, Ray P, et al.: Accuracy of data on influenza vaccination status at four vaccine safety datalink sites. Am J Prev Med 2009, 37:552-555.
• [3]Laroche JA, Diniz AJ: Immunisation registers in Canada: progress made, current situation, and challenges for the future. Euro Surveill 2012, 17:17.
• [4]Linkins RW, Feikema SM: Immunization registries: the cornerstone of childhood immunization in the 21st century. Pediatr Ann 1998, 27:349-354.
• [5]Wood D, Saarlas KN, Inkelas M, Matyas BT: Immunization registries in the United States: Implications for the practice of public health in a changing health care system. Annu Rev Public Health 1999, 20:231-255.
• [6]Salmon DA, Smith PJ, Navar AM, Pan WK, Omer SB, Singleton JA, et al.: Measuring immunization coverage among preschool children: past, present, and future opportunities. Epidemiol Rev 2006, 28:27-40.
• [7]Freeman VA, DeFriese GH: The challenge and potential of childhood immunization registries. Annu Rev Public Health 2003, 24:227-246.
• [8]Bentsi-Enchill A, Duclos P, Scott J, MacIsaac K, Halperin S: Childhood pertussis immunization status as reported by parents and the completeness of public-health and physician records in Nova Scotia. Can Commun Dis Rep 1996, 22:201-204.
• [9]Dorell CG, Jain N, Yankey D: Validity of parent-reported vaccination status for adolescents aged 13–17 years: national immunization survey-teen, 2008. Public Health Rep 2011, 126(2):60-69.
• [10]Stecher DS, Adelman R, Brinkman T, Bulloch B: Accuracy of a state immunization registry in the pediatric emergency department. Pediatr Emerg Care 2008, 24:71-74.
• [11]Suarez L, Simpson DM, Smith DR: Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. Pediatrics 1997, 99:e3.
• [12]Miles M, Ryman TK, Dietz V, Zell E, Luman ET: Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. Vaccine 2013, 31:1560-1568.
• [13]Lister S, McIntyre PB, Burgess MA, O’Brien ED: Immunisation coverage in Australian children: a systematic review 1990–1998. Commun Dis Intell 1999, 23:145-170.
• [14]Bolton P, Holt E, Ross A, Hughart N, Guyer B: Estimating vaccination coverage using parental recall, vaccination cards, and medical records. Public Health Rep 1998, 113:521.
• [15]Goldstein KP, Kviz FJ, Daum RS: Accuracy of immunization histories provided by adults accompanying preschool children to a pediatric emergency department. JAMA 1993, 270:2190-2194.
• [16]Davidson AJ, Melinkovich P, Beaty BL, Chandramouli V, Hambidge SJ, Phibbs SL, et al.: Immunization registry accuracy: improvement with progressive clinical application. Am J Prev Med 2003, 24:276-280.
• [17]Public Health Agency of Canada (PHAC: Canadian immunization registry network (CIRN). 2004. Available at http://www.phac-aspc.gc.ca/im/cirn-rcri/ webcite
• [18]Federal/Provincial/Territorial Advisory Committee on Population Health and Health Security (ACPHHS): National immunization strategy: final report. 2004. Available at http://www.phac-aspc.gc.ca/publicat/nis-sni-03/ webcite
• [19]National Vaccine Advisory Committee (NVAC): Development of community- and state-based immunization registries: report of the national vaccine advisory committee. 1999. Available at http://archive.hhs.gov/nvpo/report071100.pdf webcite
• [20]US Department of Health & Human Services: The 2010 national vaccine plan: protecting the Nation’s health through immunization. 2010. Available at http://www.hhs.gov/nvpo/vacc_plan/2010%20Plan/nationalvaccineplan.pdf webcite
• [21]Khare M, Piccinino L, Barker LE, Linkins RW: Assessment of immunization registry databases as supplemental sources of data to improve ascertainment of vaccination coverage estimates in the national immunization survey. Arch Pediatr Adolesc Med 2006, 160:838-842.
• [22]Kelly JS, Zimmerman LA, Reed K, Enger KS: Immunization information systems national research and evaluation agenda. J Public Health Manag Pract 2007, 13:35-38.
• [23]Boulianne N, Deceuninck G, Duval B, et al.: Why are some children incompletely vaccinated at the age of 2? Can J Public Health 2003, 94:218-223.
• [24]Ortega AN, Andrews SF, Katz SH, Dowshen SA, Curtice WS, Cannon ME, et al.: Comparing a computer-based childhood vaccination registry with parental vaccination cards: a population-based study of Delaware children. Clin Pediatr 1997, 36:217-221.
• [25]Mahon BE, Shea KM, Dougherty NN, Loughlin AM: Implications for registry-based vaccine effectiveness studies from an evaluation of an immunization registry: a cross-sectional study. BMC Public Health 2008, 8:160. BioMed Central Full Text
• [26]Samuels RC, Appel L, Reddy SI, Tilson RS: Improving accuracy in a computerized immunization registry. Ambul Pediatr 2002, 2:187-192.
• [27]Yusuf H, Adams M, Rodewald L, Lu P, Rosenthal J, Legum SE, et al.: Fragmentation of immunization history among providers and parents of children in selected underserved areas. Am J Prev Med 2002, 23:106-112.
• [28]Stokley S, Rodewald LE, Maes EF: The impact of record scattering on the measurement of immunization coverage. Pediatrics 2001, 107:91-86.
• [29]Wilton R, Pennisi AJ: Evaluating the accuracy of transcribed computer-stored immunization data. Pediatrics 1994, 94(6 Pt 1):902-906.
• [30]Kolasa MS, Chilkatowsky AP, Clarke KR, Lutz JP: How complete are immunization registries? the Philadelphia story. Ambul Pediatr 2006, 6:21-24.
• [31]Adams WG, Conners WP, Mann AM, Palfrey S: Immunization entry at the point of service improves quality, saves time, and is well-accepted. Pediatrics 2000, 106:489-492.
• [32]Lawrence GL, MacIntyre CR, Hull BP, McIntyre PB: Effectiveness of the linkage of child care and maternity payments to childhood immunisation. Vaccine 2004, 22:2345-2350.
• [33]Irving SA, Donahue JG, Shay DK, Ellis-Coyle TL, Belongia EA: Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. Vaccine 2009, 27:6546-6549.
• [34]Boyd TD, Linkins RW, Mason K, Bulim I, Lemke B: Assessing immunization registry data completeness in Bexar county, Texas. Am J Prev Med 2002, 22:184-187.