Methodological quality of systematic reviews on Chinese herbal medicine: a methodological survey

BMC Complementary Medicine and Therapies

Irene X. Y. Wu¹  Charlene H. L. Wong²  Andy K. L. Cheung²  Fiona Y. T. Ke²  Vincent C. H. Chung³  Leonard Ho⁴ 

[1] 5/F, Xiangya School of Public Health, Central South University, 238 Shang-Ma-Yuan-Ling Alley, Kai-Fu District, Changsha, Hunan, China;Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong;Jockey Club School of Public Health and Primary Care, The Chinese University of Hong Kong, Shatin, Hong Kong;School of Chinese Medicine, The Chinese University of Hong Kong, Shatin, Hong Kong;School of Chinese Medicine, The Chinese University of Hong Kong, Shatin, Hong Kong;

关键词: Meta-analysis;    Systematic review;    Drugs, Chinese herbal;    Evidence-based medicine;    Review literature as topic;    Medicine, Chinese traditional;   

DOI  :  10.1186/s12906-022-03529-w

来源: Springer

【 摘 要 】

BackgroundSystematic reviews (SRs) synthesise the best evidence of effectiveness and safety on Chinese herbal medicine (CHM). Decision-making should be supported by the high-quality evidence of prudently conducted SRs, but the trustworthiness of conclusions may be limited by poor methodological rigour.MethodsThis survey aimed to examine the methodological quality of a representative sample of SRs on CHM published during January 2018 to March 2020. We conducted literature search in Cochrane Database of Systematic Reviews, MEDLINE via Ovid, and EMBASE via Ovid. Eligible SRs must be in Chinese or English with at least one meta-analysis on the treatment effect of any CHM documented in the 2015 Chinese Pharmacopoeia. Two reviewers extracted the bibliographical characteristics of SRs and appraised their methodological quality using AMSTAR 2 (Assessing the Methodological Quality of Systematic Reviews 2). The associations between bibliographical characteristics and methodological quality were investigated using Kruskal-Wallis tests and Spearman’s rank correlation coefficients.ResultsWe sampled and appraised one hundred forty-eight SRs. Overall, one (0.7%) was of high methodological quality; zero (0%), four (2.7%), and one-hundred forty-three (96.6%) SRs were of moderate, low, and critically-low quality. Only thirteen SRs (8.8%) provided a pre-defined protocol; none (0%) provided justifications for including particular primary study designs; six (4.1%) conducted a comprehensive literature search; two (1.4%) provided a list of excluded studies; nine (6.1%) undertook meta-analysis with appropriate methods; and seven (4.7%) reported funding sources of included primary studies. Cochrane reviews had higher overall quality than non-Cochrane reviews (P < 0.001). SRs with European funding support were less likely to have critically-low quality when compared with their counterparts (P = 0.020). SRs conducted by more authors (rs = 0.23; P = 0.006) and published in higher impact factor journals (rs = 0.20; P = 0.044) were associated with higher methodological quality.ConclusionsOur results indicated that the methodological quality of SRs on CHM is low. Future authors should enhance the methodological quality through registering a priori protocols, justifying selection of study designs, conducting comprehensive literature search, providing a list of excluded studies with rationales, using appropriate method for meta-analyses, and reporting funding sources among primary studies.

【 授权许可】

CC BY