Is single reading with computer-aided detection (CAD) as good as double reading in mammography screening? A systematic review

BMC Medical Imaging

Marianne Heibert Arnlind¹  Ingegerd Mejàre²  Sophia Zackrisson³  Edward Azavedo¹ 

[1] LIME/MMC, Karolinska Institutet, Stockholm, Sweden;Swedish Council on Health Technology Assessment (SBU), Stockholm, Sweden;Department of Clinical Sciences in Malmö, Diagnostic Radiology, Lund University, Skåne University Hospital Malmö, Malmö, SE-205 02, Sweden

关键词: Double reading;    Single reading;    Cancer;    Breast;    Screening;    Mammography;    CAD;   

Others  :  1091917
DOI  :  10.1186/1471-2342-12-22

 received in 2012-04-20, accepted in 2012-06-23,  发布年份 2012

【 摘 要 】

Background

In accordance with European guidelines, mammography screening comprises independent readings by two breast radiologists (double reading). CAD (computer-aided detection) has been suggested to complement or replace one of the two readers (single reading + CAD).

The aim of this systematic review is to address the following question: Is the reading of mammographic x-ray images by a single breast radiologist together with CAD at least as accurate as double reading?

Methods

The electronic literature search included the databases Pub Med, EMBASE and The Cochrane Library. Two independent reviewers assessed abstracts and full-text articles.

Results

1049 abstracts were identified, of which 996 were excluded with reference to inclusion and exclusion criteria; 53 full-text articles were assessed for eligibility. Finally, four articles were included in the qualitative analysis, and one in a GRADE synthesis.

Conclusions

The scientific evidence is insufficient to determine whether the accuracy of single reading + CAD is at least equivalent to that obtained in standard practice, i.e. double reading where two breast radiologists independently read the mammographic images.

【 授权许可】

   
2012 Azavedo et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

Figure 2.

【 参考文献 】

• [1]Tabar L, Fagerberg CJ, Gad A, Baldetorp L, Holmberg LH, Grontoft O, Ljungquist U, Lundstrom B, Manson JC, Eklund G, et al.: Reduction in mortality from breast cancer after mass screening with mammography. Randomised trial from the Breast Cancer Screening Working Group of the Swedish National Board of Health and Welfare. Lancet 1985, 1(8433):829-832.
• [2]Andersson I, Aspegren K, Janzon L, Landberg T, Lindholm K, Linell F, Ljungberg O, Ranstam J, Sigfusson B: Mammographic screening and mortality from breast cancer: the Malmo mammographic screening trial. BMJ 1988, 297(6654):943-948.
• [3]Bjurstam N, Bjorneld L, Duffy SW, Smith TC, Cahlin E, Eriksson O, Hafstrom LO, Lingaas H, Mattsson J, Persson S, et al.: The Gothenburg breast screening trial: first results on mortality, incidence, and mode of detection for women ages 39–49 years at randomization. Cancer 1997, 80(11):2091-2099.
• [4]Frisell J, Glas U, Hellstrom L, Somell A: Randomized mammographic screening for breast cancer in Stockholm. Design, first round results and comparisons. Breast Cancer Res Treat 1986, 8(1):45-54.
• [5]Vainio H, Bianchini F: IARC Handbooks of Cancer Prevention- Breast Cancer Screening. IARCPress, Lyon, France; 2002:2002.
• [6]Nystrom L, Andersson I, Bjurstam N, Frisell J, Nordenskjold B, Rutqvist LE: Long-term effects of mammography screening: updated overview of the Swedish randomised trials. Lancet 2002, 359(9310):909-919.
• [7]Tabar L, Vitak B, Chen TH, Yen AM, Cohen A, Tot T, Chiu SY, Chen SL, Fann JC, Rosell J, et al.: Swedish two-county trial: impact of mammographic screening on breast cancer mortality during 3 decades. Radiology 2011, 260(3):658-663.
• [8]Hellquist BN, Duffy SW, Abdsaleh S, Bjorneld L, Bordas P, Tabar L, Vitak B, Zackrisson S, Nystrom L, Jonsson H: Effectiveness of population-based service screening with mammography for women ages 40 to 49 years: evaluation of the Swedish Mammography Screening in Young Women (SCRY) cohort. Cancer 2011, 117(4):714-722.
• [9]SOSSEG SOSSEG: Reduction in breast cancer mortality from organized service screening with mammography: 1. Further confirmation with extended data. Cancer Epidemiol Biomarkers Prev 2006, 15(1):45-51.
• [10]Gotzsche PC, Nielsen M: Screening for breast cancer with mammography. Cochrane Database Syst Rev 2011, (1):CD001877.
• [11]Perry N, Broeders M, de Wolf C, Törnberg S, Holland R, von Karsa L: European guidelines for quality assurance in breast cancer screening and diagnosis. 4th edition. Office for Official Publications of the European Communities, Luxembourg; 2006. ISBN 2006 ISBN 92-79-01258-4: EU
• [12]Helvie M: Improving mammographic interpretation: double reading and computer-aided diagnosis. Radiol Clin North Am 2007, 45(5):801-811. vi
• [13]Guerriero C, Gillan MG, Cairns J, Wallis MG, Gilbert FJ: Is computer aided detection (CAD) cost effective in screening mammography? A model based on the CADET II study. BMC Health Serv Res 2011, 11(1):11. BioMed Central Full Text
• [14]Taylor P, Champness J, Given-Wilson R, Johnston K, Potts H: Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography. Health Technol Assess 2005, 9(6):1-58. iii
• [15]Houssami N, Given-Wilson R: Incorporating new technologies into clinical practice without evidence of effectiveness in prospective studies: computer-aided detection (CAD) in breast screening reinforces the need for better initial evaluation. Breast 2007, 16(3):219-221.
• [16]Houssami N, Given-Wilson R, Ciatto S: Early detection of breast cancer: overview of the evidence on computer-aided detection in mammography screening. J Med Imaging Radiat Oncol 2009, 53(2):171-176.
• [17]Taylor P, Potts HW: Computer aids and human second reading as interventions in screening mammography: two systematic reviews to compare effects on cancer detection and recall rate. Eur J Cancer 2008, 44(6):798-807.
• [18]Bennett RL, Blanks RG, Moss SM: Does the accuracy of single reading with CAD (computer-aided detection) compare with that of double reading?: A review of the literature. Clin Radiol 2006, 61(12):1023-1028.
• [19]SBU: Computer-Aided Detection (CAD) in Mammography Screening. Statens beredning för medicinsk utvärdering (SBU): SBU, Stockholm; 2011.
• [20]Azavedo E, Svane G: Radiologic aspects of breast cancers detected through a breast cancer screening program. Eur J Radiol 1991, 13(2):88-90.
• [21]Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 2003, 3:25. BioMed Central Full Text
• [22]Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008, 336(7650):924-926.
• [23]Schunemann HJ, Oxman AD, Brozek J, Glasziou P, Bossuyt P, Chang S, Muti P, Jaeschke R, Guyatt GH: GRADE: assessing the quality of evidence for diagnostic recommendations. Evid Based Med 2008, 13(6):162-163.
• [24]Boyer B, Balleyguier C, Granat O, Pharaboz C: CAD in questions/answers Review of the literature. Eur J Radiol 2009, 69(1):24-33.
• [25]G-S G, Chersevani R, Ciatto S, Del Favero C, Frigerio A, Giordano L, Giuseppetti G, Naldoni C, Panizza P, Petrella M, Chersevani R, Ciatto S, Del Favero C, Frigerio A, Giordano L, Giuseppetti G, Naldoni C, Panizza P, Petrella M, Gruppo di studio G-S, et al.: "CADEAT": considerations on the use of CAD (computer-aided diagnosis) in mammography. La Radiologia medica 2010, 115(4):563-570.
• [26]Kolb GR: The financial impact of computer-aided detection on the mammography practice. Applied Radiology 2001, 30(11 SUPPL.):21-24.
• [27]Nishikawa RM: Evaluation of computer-aided detection and computer detection systems. Applied Radiology 2001, 30(11 SUPPL.):14-16.
• [28]Noble M, Bruening W, Uhl S, Schoelles K: Computer-aided detection mammography for breast cancer screening: systematic review and meta-analysis. Arch Gynecol Obstet 2009, 279(6):881-890.
• [29]Cawson JN, Nickson C, Amos A, Hill G, Whan AB, Kavanagh AM: Invasive breast cancers detected by screening mammography: a detailed comparison of computer-aided detection-assisted single reading and double reading. J Med Imaging Radiat Oncol 2009, 53(5):442-449.
• [30]van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Flobbe K: Strategies for digital mammography interpretation in a clinical patient population. Int J Cancer 2009, 125(12):2923-2929.
• [31]Paquerault S, Samuelson FW, Petrick N, Myers KJ, Smith RC: Investigation of reading mode and relative sensitivity as factors that influence reader performance when using computer-aided detection software. Acad Radiol 2009, 16(9):1095-1107.
• [32]van den Biggelaar FJ, Kessels AG, van Engelshoven JM, Boetes C, Flobbe K: Computer-aided detection in full-field digital mammography in a clinical population: performance of radiologist and technologists. Breast Cancer Res Treat 2010, 120(2):499-506.
• [33]James JJ, Cornford EJ: Does computer-aided detection have a role in the arbitration of discordant double-reading opinions in a breast-screening programme? Clin Radiol 2009, 64(1):46-51.
• [34]Kim SJ, Moon WK, Cho N, Cha JH, Kim SM, Im JG: Computer-aided detection in full-field digital mammography: sensitivity and reproducibility in serial examinations. Radiology 2008, 246(1):71-80.
• [35]Brancato B, Houssami N, Francesca D, Bianchi S, Risso G, Catarzi S, Taschini R, Rosselli Del Turco M, Ciatto S: Does computer-aided detection (CAD) contribute to the performance of digital mammography in a self-referred population? Breast Cancer Res Treat 2008, 111(2):373-376.
• [36]Yang SK, Moon WK, Cho N, Park JS, Cha JH, Kim SM, Kim SJ, Im JG: Screening mammography-detected cancers: sensitivity of a computer-aided detection system applied to full-field digital mammograms. Radiology 2007, 244(1):104-111.
• [37]Skaane P, Kshirsagar A, Stapleton S, Young K, Castellino RA: Effect of computer-aided detection on independent double reading of paired screen-film and full-field digital screening mammograms. AJR Am J Roentgenol 2007, 188(2):377-384.
• [38]Gilbert FJ, Astley SM, McGee MA, Gillan MG, Boggis CR, Griffiths PM, Duffy SW: Single reading with computer-aided detection and double reading of screening mammograms in the United Kingdom National Breast Screening Program. Radiology 2006, 241(1):47-53.
• [39]Dean JC, Ilvento CC: Improved cancer detection using computer-aided detection with diagnostic and screening mammography: prospective study of 104 cancers. AJR Am J Roentgenol 2006, 187(1):20-28.
• [40]Hukkinen K, Vehmas T, Pamilo M, Kivisaari L: Effect of computer-aided detection on mammographic performance: experimental study on readers with different levels of experience. Acta Radiol 2006, 47(3):257-263.
• [41]Ciatto S, Ambrogetti D, Collini G, Cruciani A, Ercolini E, Risso G, Rosselli Del Turco M: Computer-aided detection (CAD) of cancers detected on double reading by one reader only. Breast 2006, 15(4):528-532.
• [42]Hukkinen K, Pamilo M: Does computer-aided detection assist in the early detection of breast cancer? Acta Radiol 2005, 46(2):135-139.
• [43]Destounis SV, DiNitto P, Logan-Young W, Bonaccio E, Zuley ML, Willison KM: Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? Initial experience. Radiology 2004, 232(2):578-584.
• [44]Ciatto S, Rosselli Del Turco M, Burke P, Visioli C, Paci E, Zappa M: Comparison of standard and double reading and computer-aided detection (CAD) of interval cancers at prior negative screening mammograms: blind review. Br J Cancer 2003, 89(9):1645-1649.
• [45]Ciatto S, Brancato B, Rosselli Del Turco M, Risso G, Catarzi S, Morrone D, Bricolo D, Zappa M: Comparison of standard reading and computer aided diagnosis (CAD) on a proficiency test of screening mammography. Radiol Med 2003, 106(1–2):59-65.
• [46]Brem RF, Baum J, Lechner M, Kaplan S, Souders S, Naul LG, Hoffmeister J: Improvement in sensitivity of screening mammography with computer-aided detection: a multiinstitutional trial. AJR Am J Roentgenol 2003, 181(3):687-693.
• [47]Quek ST, Thng CH, Khoo JB, Koh WL: Radiologists' detection of mammographic abnormalities with and without a computer-aided detection system. Australas Radiol 2003, 47(3):257-260.
• [48]Zheng B, Hardesty LA, Poller WR, Sumkin JH, Golla S: Mammography with computer-aided detection: reproducibility assessment initial experience. Radiology 2003, 228(1):58-62.
• [49]Karssemeijer N, Otten JD, Verbeek AL, Groenewoud JH, de Koning HJ, Hendriks JH, Holland R: Computer-aided detection versus independent double reading of masses on mammograms. Radiology 2003, 227(1):192-200.
• [50]Ciatto S, Del Turco MR, Risso G, Catarzi S, Bonardi R, Viterbo V, Gnutti P, Guglielmoni B, Pinelli L, Pandiscia A, et al.: Comparison of standard reading and computer aided detection (CAD) on a national proficiency test of screening mammography. Eur J Radiol 2003, 45(2):135-138.
• [51]Malich A, Marx C, Facius M, Boehm T, Fleck M, Kaiser WA: Tumour detection rate of a new commercially available computer-aided detection system. Eur Radiol 2001, 11(12):2454-2459.
• [52]Moberg K, Bjurstam N, Wilczek B, Rostgard L, Egge E, Muren C: Computed assisted detection of interval breast cancers. Eur J Radiol 2001, 39(2):104-110.
• [53]Warren Burhenne LJ, Wood SA, D'Orsi CJ, Feig SA, Kopans DB, O'Shaughnessy KF, Sickles EA, Tabar L, Vyborny CJ, Castellino RA: Potential contribution of computer-aided detection to the sensitivity of screening mammography. Radiology 2000, 215(2):554-562.
• [54]Jiang Y, Nishikawa RM, Schmidt RA, Metz CE, Giger ML, Doi K: Improving breast cancer diagnosis with computer-aided diagnosis. Acad Radiol 1999, 6(1):22-33.
• [55]Thurfjell E, Thurfjell MG, Egge E, Bjurstam N: Sensitivity and specificity of computer-assisted breast cancer detection in mammography screening. Acta Radiol 1998, 39(4):384-388.
• [56]Sang KY, Woo KM, Cho N, Jeong SP, Joo HC, Sun MK, Seung JK, Im JG: Screening mammography-detected cancers: Sensitivity of a computer-aided detection system applied to full-field digital mammograms. Radiology 2007, 244(1):104-111.
• [57]Li JG, Li S, Xu HM, Xu K: Evaluation on the use and results of computer-aided detection for full-field digital mammorgraphy. Chinese Journal of Radiology 2006, 40(7):729-732.
• [58]Birdwell RL, Bandodkar P, Ikeda DM: Computer-aided detection with screening mammography in a university hospital setting. Radiology 2005, 236(2):451-457.
• [59]Cupples TE, Cunningham JE, Reynolds JC: Impact of computer-aided detection in a regional screening mammography program. AJR Am J Roentgenol 2005, 185(4):944-950.
• [60]Fenton JJ, Taplin SH, Carney PA, Abraham L, Sickles EA, D'Orsi C, Berns EA, Cutter G, Hendrick RE, Barlow WE, et al.: Influence of computer-aided detection on performance of screening mammography. N Engl J Med 2007, 356(14):1399-1409.
• [61]Freer TW, Ulissey MJ: Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. Radiology 2001, 220(3):781-786.
• [62]Gur D, Sumkin JH, Rockette HE, Ganott M, Hakim C, Hardesty L, Poller WR, Shah R, Wallace L: Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst 2004, 96(3):185-190.
• [63]Karssemeijer N, Bluekens AM, Beijerinck D, Deurenberg JJ, Beekman M, Visser R, van Engen R, Bartels-Kortland A, Broeders MJ: Breast cancer screening results 5 years after introduction of digital mammography in a population-based screening program. Radiology 2009, 253(2):353-358.
• [64]Ko JM, Nicholas MJ, Mendel JB, Slanetz PJ: Prospective assessment of computer-aided detection in interpretation of screening mammography. AJR Am J Roentgenol 2006, 187(6):1483-1491.
• [65]Morton MJ, Whaley DH, Brandt KR, Amrami KK: Screening mammograms: interpretation with computer-aided detection–prospective evaluation. Radiology 2006, 239(2):375-383.
• [66]Sanchez Gomez S, Torres Tabanera M, Vega Bolivar A, Sainz Miranda M, Baroja Mazo A, Ruiz Diaz M, Martinez Miravete P, Lag Asturiano E, Munoz Cacho P, Delgado Macias T: Impact of a CAD system in a screen-film mammography screening program: A prospective study. Eur J Radiol 2010.
• [67]James JJ, Gilbert FJ, Wallis MG, Gillan MG, Astley SM, Boggis CR, Agbaje OF, Brentnall AR, Duffy SW: Mammographic features of breast cancers at single reading with computer-aided detection and at double reading in a large multicenter prospective trial of computer-aided detection: CADET II. Radiology 2010, 256(2):379-386.
• [68]Georgian-Smith D, Moore RH, Halpern E, Yeh ED, Rafferty EA, D'Alessandro HA, Staffa M, Hall DA, McCarthy KA, Kopans DB: Blinded comparison of computer-aided detection with human second reading in screening mammography. AJR Am J Roentgenol 2007, 189(5):1135-1141.
• [69]Gromet M: Comparison of computer-aided detection to double reading of screening mammograms: review of 231,221 mammograms. AJR Am J Roentgenol 2008, 190(4):854-859.
• [70]Khoo LA, Taylor P, Given-Wilson RM: Computer-aided detection in the United Kingdom National Breast Screening Programme: prospective study. Radiology 2005, 237(2):444-449.
• [71]Gilbert FJ, Astley SM, Gillan MG, Agbaje OF, Wallis MG, James J, Boggis CR, Duffy SW: Single reading with computer-aided detection for screening mammography. N Engl J Med 2008, 359(16):1675-1684.
• [72]Azavedo E, Svane G: Radial scars detected mammographically in a breast cancer screening programme. Eur J Radiol 1992, 15(1):18-21.
• [73]Malich A, Azhari T, Bohm T, Fleck M, Kaiser WA: Reproducibility–an important factor determining the quality of computer-aided detection (CAD) systems. Eur J Radiol 2000, 36(3):170-174.
• [74]Luo P, Qian W, Romilly P: CAD-aided mammogram training. Acad Radiol 2005, 12(8):1039-1048.