Methodological quality and implications for practice of systematic Cochrane reviews in pediatric oral health: a critical assessment

BMC Oral Health

Frédéric Courson¹  Hélène Fron-Chabouis²  Violaine Smaïl-Faugeron¹ 

[1] Université Paris Descartes - Sorbonne Paris Cité, Faculté de Chirurgie Dentaire, Unité de Recherches Biomatériaux Innovants et Interface EA4462, 1 rue Maurice Arnoux, 92120 Montrouge, France;Assistance Publique-Hôpitaux de Paris, Hôpital Charles Foix, Service d’Odontologie, Ivry-sur-Seine, France

关键词: Caries prevention;    Implication for practice;    Children oral health;    Cochrane collaboration;    Systematic reviews;   

Others  :  1109901
DOI  :  10.1186/1472-6831-14-35

 received in 2013-12-19, accepted in 2014-03-31,  发布年份 2014

【 摘 要 】

Background

To ensure evidence-based decision-making in pediatric oral health, Cochrane systematic reviews that address topics pertinent to this field are necessary. We aimed to identify all systematic reviews of paediatric dentistry and oral health by the Cochrane Oral Health Group (COHG), summarize their characteristics and assess their methodological quality. Our second objective was to assess implications for practice in the review conclusions and provide an overview of clinical implications about the usefulness of paediatric oral health interventions in practice.

Methods

We conducted a methodological survey including all paediatric dentistry reviews from the COHG. We extracted data on characteristics of included reviews, then assessed the methodological quality using a validated 11-item quality assessment tool (AMSTAR). Finally, we coded each review to indicate whether its authors concluded that an intervention should be implemented in practice, was not supported or was refuted by the evidence, or should be used only in research (inconclusive evidence).

Results

We selected 37 reviews; most concerned the prevention of caries. The methodological quality was high, except for the assessment of reporting bias. In 7 reviews (19%), the research showed that benefits outweighed harms; in 1, the experimental intervention was found ineffective; and in 29 (78%), evidence was insufficient to assess benefits and harms. In the 7 reviews, topical fluoride treatments (with toothpaste, gel or varnish) were found effective for permanent and deciduous teeth in children and adolescents, and sealants for occlusal tooth surfaces of permanent molars.

Conclusions

Cochrane reviews of paediatric dentistry were of high quality. They provided strong evidence that topical fluoride treatments and sealants are effective for children and adolescents and thus should be implemented in practice. However, a substantial number of reviews yielded inconclusive evidence.

【 授权许可】

   
2014 Smaïl-Faugeron et al.; licensee BioMed Central Ltd.

【 图 表 】

Figure 1.

【 参考文献 】

• [1]Higgins J, Green S: Cochrane Handbook for Systematic Reviews of Interventions 5.1.0 [updated March 2011]. The Cochrane Collaboration; 2011. Available from: http://www.cochrane-handbook.org webcite
• [2]Moher D, Jadad AR, Nichol G, Penman M, Tugwell P, Walsh S: Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials 1995, 16(1):62-73.
• [3]Mulrow CD: Rationale for systematic reviews. BMJ 1994, 309(6954):597-599.
• [4]Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007, 7:10. BioMed Central Full Text
• [5]Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M: AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol 2009, 62(10):1013-1020.
• [6]Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 2009, 6(7):e1000100.
• [7]Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M, Littlejohns P: Reducing ineffective practice: challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy 2013, 18(1):6-12.
• [8]Clarke M, Clarke T, Clarke L: Cochrane systematic reviews as a source of information for practice and trials. Trials 2011, 12(Suppl 1):A49. BioMed Central Full Text
• [9]Ahovuo-Saloranta A, Forss H, Walsh T, Hiiri A, Nordblad A, Makela M, Worthington HV: Sealants for preventing dental decay in the permanent teeth. Cochrane Database Syst Rev 2013. , 3, CD001830
• [10]Al-Harasi S, Ashley PF, Moles DR, Parekh S, Walters V: Hypnosis for children undergoing dental treatment. Cochrane Database Syst Rev 2010. , 8, CD007154
• [11]Ashley PF, Parekh S, Moles DR, Anand P, Behbehani A: Preoperative analgesics for additional pain relief in children and adolescents having dental treatment. Cochrane Database Syst Rev 2012. , 9, CD008392
• [12]Ashley PF, Williams CE, Moles DR, Parry J: Sedation versus general anaesthesia for provision of dental treatment in under 18 year olds. Cochrane Database Syst Rev 2012. , 11, CD006334
• [13]Beirne P, Clarkson JE, Worthington HV: Recall intervals for oral health in primary care patients. Cochrane Database Syst Rev 2007. , 4, CD004346
• [14]Belmonte FM, Macedo CR, Day PF, Saconato H, Fernandes Moca Trevisani V: Interventions for treating traumatised permanent front teeth: luxated (dislodged) teeth. Cochrane Database Syst Rev 2013. , 4, CD006203
• [15]Benson PE, Parkin N, Millett DT, Dyer FE, Vine S, Shah A: Fluorides for the prevention of white spots on teeth during fixed brace treatment. Cochrane Database Syst Rev 2004. , 3, CD003809
• [16]Bessell A, Hooper L, Shaw WC, Reilly S, Reid J, Glenny AM: Feeding interventions for growth and development in infants with cleft lip, cleft palate or cleft lip and palate. Cochrane Database Syst Rev 2011. , 2, CD003315
• [17]Bonner BC, Clarkson JE, Dobbyn L, Khanna S: Slow-release fluoride devices for the control of dental decay. Cochrane Database Syst Rev 2006. , 4, CD005101
• [18]Carvalho FR, Lentini-Oliveira D, Machado MA, Prado GF, Prado LB, Saconato H: Oral appliances and functional orthopaedic appliances for obstructive sleep apnoea in children. Cochrane Database Syst Rev 2007. , 2, CD005520
• [19]Cooper AM, O’Malley LA, Elison SN, Armstrong R, Burnside G, Adair P, Dugdill L, Pine C: Primary school-based behavioural interventions for preventing caries. Cochrane Database Syst Rev 2013. , 5, CD009378
• [20]Dashash M, Yeung CA, Jamous I, Blinkhorn A: Interventions for the restorative care of amelogenesis imperfecta in children and adolescents. Cochrane Database Syst Rev 2013. , 6, CD007157
• [21]Guo J, Li C, Zhang Q, Wu G, Deacon SA, Chen J, Hu H, Zou S, Ye Q: Secondary bone grafting for alveolar cleft in children with cleft lip or cleft lip and palate. Cochrane Database Syst Rev 2011. , 6, CD008050
• [22]Harrison JE, O’Brien KD, Worthington HV: Orthodontic treatment for prominent upper front teeth in children. Cochrane Database Syst Rev 2007. , 3, CD003452
• [23]Hiiri A, Ahovuo-Saloranta A, Nordblad A, Makela M: Pit and fissure sealants versus fluoride varnishes for preventing dental decay in children and adolescents. Cochrane Database Syst Rev 2010. , 3, CD003067
• [24]Innes NP, Ricketts DN, Evans DJ: Preformed metal crowns for decayed primary molar teeth. Cochrane Database Syst Rev 2007. , 1, CD005512
• [25]Lentini-Oliveira D, Carvalho FR, Qingsong Y, Junjie L, Saconato H, Machado MA, Prado LB, Prado GF: Orthodontic and orthopaedic treatment for anterior open bite in children. Cochrane Database Syst Rev 2007. , 2, CD005515
• [26]Lourenco-Matharu L, Ashley PF, Furness S: Sedation of children undergoing dental treatment. Cochrane Database Syst Rev 2012. , 3, CD003877
• [27]Marinho VC, Higgins JP, Logan S, Sheiham A: Fluoride gels for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2002. , 2, CD002280
• [28]Marinho VC, Higgins JP, Logan S, Sheiham A: Topical fluoride (toothpastes, mouthrinses, gels or varnishes) for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2003. , 4, CD002782
• [29]Marinho VC, Higgins JP, Logan S, Sheiham A: Fluoride mouthrinses for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2003. , 3, CD002284
• [30]Marinho VC, Higgins JP, Sheiham A, Logan S: Fluoride toothpastes for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2003. , 1, CD002278
• [31]Marinho VC, Higgins JP, Sheiham A, Logan S: Combinations of topical fluoride (toothpastes, mouthrinses, gels, varnishes) versus single topical fluoride for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2004. , 1, CD002781
• [32]Marinho VC, Higgins JP, Sheiham A, Logan S: One topical fluoride (toothpastes, or mouthrinses, or gels, or varnishes) versus another for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2004. , 1, CD002780
• [33]Marinho VC, Worthington HV, Walsh T, Clarkson JE: Fluoride varnishes for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2013. , 7, CD002279
• [34]Mettes TD, Ghaeminia H, Nienhuijs ME, Perry J, van der Sanden WJ, Plasschaert A: Surgical removal versus retention for the management of asymptomatic impacted wisdom teeth. Cochrane Database Syst Rev 2012. , 6, CD003879
• [35]Millett DT, Cunningham SJ, O’Brien KD, Benson P, Williams A, de Oliveira CM: Orthodontic treatment for deep bite and retroclined upper front teeth in children. Cochrane Database Syst Rev 2006. , 4, CD005972
• [36]Nadin G, Goel BR, Yeung CA, Glenny AM: Pulp treatment for extensive decay in primary teeth. Cochrane Database Syst Rev 2003. , 1, CD003220
• [37]Nasser M, Fedorowicz Z, Khoshnevisan MH, Shahiri Tabarestani M: Acyclovir for treating primary herpetic gingivostomatitis. Cochrane Database Syst Rev 2008. , 4, CD006700
• [38]Nasser M, Fedorowicz Z, Newton JT, Nouri M: Interventions for the management of submucous cleft palate. Cochrane Database Syst Rev 2008. , 1, CD006703
• [39]Parkin N, Benson PE, Thind B, Shah A: Open versus closed surgical exposure of canine teeth that are displaced in the roof of the mouth. Cochrane Database Syst Rev 2008. , 4, CD006966
• [40]Parkin N, Furness S, Shah A, Thind B, Marshman Z, Glenroy G, Dyer F, Benson PE: Extraction of primary (baby) teeth for unerupted palatally displaced permanent canine teeth in children. Cochrane Database Syst Rev 2012. , 12, CD004621
• [41]Tubert-Jeannin S, Auclair C, Amsallem E, Tramini P, Gerbaud L, Ruffieux C, Schulte AG, Koch MJ, Rege-Walther M, Ismail A: Fluoride supplements (tablets, drops, lozenges or chewing gums) for preventing dental caries in children. Cochrane Database Syst Rev 2011. , 12, CD007592
• [42]Walsh T, Worthington HV, Glenny AM, Appelbe P, Marinho VC, Shi X: Fluoride toothpastes of different concentrations for preventing dental caries in children and adolescents. Cochrane Database Syst Rev 2010. , 1, CD007868
• [43]Wong MC, Glenny AM, Tsang BW, Lo EC, Worthington HV, Marinho VC: Topical fluoride as a cause of dental fluorosis in children. Cochrane Database Syst Rev 2010. , 1, CD007693
• [44]Yengopal V, Harneker SY, Patel N, Siegfried N: Dental fillings for the treatment of caries in the primary dentition. Cochrane Database Syst Rev 2009. , 2, CD004483
• [45]Yeung CA, Hitchings JL, Macfarlane TV, Threlfall AG, Tickle M, Glenny AM: Fluoridated milk for preventing dental caries. Cochrane Database Syst Rev 2005. , 3, CD003876
• [46]Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, Guyatt GH, Harbour RT, Haugh MC, Henry D, Hill S, Jaeschke R, Leng G, Liberati A, Magrini N, Mason J, Middleton P, Mrukowicz J, O’Connell D, Oxman AD, Phillips B, Schünemann HJ, Edejer T, Varonen H, Vist GE, Williams JW Jr, Zaza S, GRADE Working Group: Grading quality of evidence and strength of recommendations. BMJ 2004, 328(7454):1490.
• [47]Egger M, Davey Smith G, Schneider M, Minder C: Bias in meta-analysis detected by a simple, graphical test. BMJ 1997, 315(7109):629-634.
• [48]Oral health in America: a report of the Surgeon General J Calif Dent Assoc 2000, 28(9):685-695.
• [49]Goldberg M: In vitro and in vivo studies on the toxicity of dental resin components: a review. Clin Oral Investig 2008, 12(1):1-8.
• [50]Koral SM: Mercury from dental amalgam: exposure and risk assessment. Compend Contin Educ Dent 2013, 34(2):138-140. 142, 144 passim
• [51]Davey J, Turner RM, Clarke MJ, Higgins JP: Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis. BMC Med Res Methodol 2011, 11:160. BioMed Central Full Text
• [52]Clarke M: Standardising outcomes for clinical trials and systematic reviews. Trials 2007, 8:39. BioMed Central Full Text
• [53]Williamson P, Clarke M: The COMET (Core Outcome Measures in Effectiveness Trials) initiative: its role in improving cochrane reviews. Cochrane Database Syst Rev 2012. , 5, ED000041
• [54]Furukawa TA, Watanabe N, Omori IM, Montori VM, Guyatt GH: Association between unreported outcomes and effect size estimates in Cochrane meta-analyses. JAMA 2007, 297(5):468-470.
• [55]Tugwell P, Boers M, Brooks P, Simon L, Strand V, Idzerda L: OMERACT: an international initiative to improve outcome measurement in rheumatology. Trials 2007, 8:38. BioMed Central Full Text
• [56]Williamson P, Altman D, Blazeby J, Clarke M, Gargon E: Driving up the quality and relevance of research through the use of agreed core outcomes. J Health Serv Res Policy 2012, 17(1):1-2.
• [57]Carr A, Wolfaardt J, Garrett N: Capturing patient benefits of treatment. Int J Oral Maxillofac Implants 2011, 26(Suppl):85-92. discussion 101-102
• [58]Faggion CM Jr, Listl S, Tu YK: Assessment of endpoints in studies on peri-implantitis treatment–a systematic review. J Dent 2010, 38(6):443-450.
• [59]Needleman I, Chin S, O’Brien T, Petrie A, Donos N: Systematic review of outcome measurements and reference group(s) to evaluate and compare implant success and failure. J Clin Periodontol 2012, 39(Suppl 12):122-132.
• [60]Papaspyridakos P, Chen CJ, Singh M, Weber HP, Gallucci GO: Success criteria in implant dentistry: a systematic review. J Dent Res 2012, 91(3):242-248.
• [61]Smail-Faugeron V, Fron Chabouis H, Durieux P, Attal JP, Muller-Bolla M, Courson F: Development of a core set of outcomes for randomized controlled trials with multiple outcomes–example of pulp treatments of primary teeth for extensive decay in children. PLoS One 2013, 8(1):e51908.
• [62]Chalmers I: Well informed uncertainties about the effects of treatments. BMJ 2004, 328(7438):475-476.
• [63]Chalmers I Sr: Systematic reviews and uncertainties about the effects of treatments. Cochrane Database Syst Rev 2011. , 2011, ED000004
• [64]Fleming PS, Seehra J, Polychronopoulou A, Fedorowicz Z, Pandis N: Cochrane and non-Cochrane systematic reviews in leading orthodontic journals: a quality paradigm? Eur J Orthod 2013, 35(2):244-248.
• [65]Fleming PS, Seehra J, Polychronopoulou A, Fedorowicz Z, Pandis N: A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod 2013, 83(1):158-163.
• [66]Sequeira-Byron P, Fedorowicz Z, Jagannath VA, Sharif MO: An AMSTAR assessment of the methodological quality of systematic reviews of oral healthcare interventions published in the Journal of Applied Oral Science (JAOS). J Appl Oral Sci 2011, 19(5):440-447.
• [67]ADA. Center for Evidence-Based Dentistry Available: http://www.cdc.gov/nchs/nhanes.htm webcite