Cross-validation to select Bayesian hierarchical models in phylogenetics

BMC Evolutionary Biology

Methodology Article

Kathryn E. Holt¹  Sebastián Duchêne²  Edward C. Holmes²  John-Sebastian Eden²  Francesca Di Giallonardo²  Jemma L. Geoghegan²  David A. Duchêne³  Simon Y. W. Ho³ 

[1] Department of Biochemistry and Molecular Biology, Bio21 Molecular Science and Biotechnology Institute, The University of Melbourne, 3010, Melbourne, VIC, Australia;Centre for Systems Genomics, The University of Melbourne, 3010, Melbourne, VIC, Australia;Marie Bashir Institute of Infectious Diseases and Biosecurity, Charles Perkins Centre, Sydney Medical School, University of Sydney, 2006, Sydney, NSW, Australia;School of Life and Environmental Sciences, University of Sydney, 2006, Sydney, NSW, Australia;School of Life and Environmental Sciences, University of Sydney, 2006, Sydney, NSW, Australia;

关键词: Model selection;    Cross-validation;    Bayesian phylogenetics;    Molecular clock;    Demographic models;    Marginal likelihood;   

DOI  :  10.1186/s12862-016-0688-y

 received in 2016-02-29, accepted in 2016-05-19,  发布年份 2016

来源: Springer

【 摘 要 】

BackgroundRecent developments in Bayesian phylogenetic models have increased the range of inferences that can be drawn from molecular sequence data. Accordingly, model selection has become an important component of phylogenetic analysis. Methods of model selection generally consider the likelihood of the data under the model in question. In the context of Bayesian phylogenetics, the most common approach involves estimating the marginal likelihood, which is typically done by integrating the likelihood across model parameters, weighted by the prior. Although this method is accurate, it is sensitive to the presence of improper priors. We explored an alternative approach based on cross-validation that is widely used in evolutionary analysis. This involves comparing models according to their predictive performance.ResultsWe analysed simulated data and a range of viral and bacterial data sets using a cross-validation approach to compare a variety of molecular clock and demographic models. Our results show that cross-validation can be effective in distinguishing between strict- and relaxed-clock models and in identifying demographic models that allow growth in population size over time. In most of our empirical data analyses, the model selected using cross-validation was able to match that selected using marginal-likelihood estimation. The accuracy of cross-validation appears to improve with longer sequence data, particularly when distinguishing between relaxed-clock models.ConclusionsCross-validation is a useful method for Bayesian phylogenetic model selection. This method can be readily implemented even when considering complex models where selecting an appropriate prior for all parameters may be difficult.

【 授权许可】

CC BY   
© The Author(s). 2016