Comparison between different methods of model selection in cosmology

Abstract

There are several methods for model selection in cosmology which have at least two major goals, that of finding the correct model or predicting well. In this work we discuss through a study of well-known model selection methods like Akaike information criterion (AIC), Bayesian information criterion (BIC), deviance information criterion (DIC) and Bayesian evidence, how these different goals are pursued in each paradigm. We also apply another method for model selection which less seen in cosmological literature, the Cross-validation method. Using these methods we will compare two different scenarios in cosmology, $\Lambda$CDM model and dynamical dark energy. We show that each of the methods tends to different results in model selection. While BIC and Bayesian evidence overrule the dynamical dark energy scenarios with 2 or 3 extra degree of freedom, the DIC and cross-validation method prefer these dynamical models to $\Lambda$CDM model. Assuming the numerical results of different analysis and combining cosmological and statistical aspects of the subject, we propose cross-validation as an interesting method for model selection in cosmology that can lead to different results in comparison with usual methods of model selection.

12 pages, 3 figures, PUBLISHED IN EPJP. arXiv admin note: text overlap with arXiv:1510.00547 by other authors

References in corpus (22)

• Dynamics of dark energy
• Unified cosmic history in modified gravity: from F(R) theory to Lorentz non-invariant models
• Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
• The Clustering of the SDSS DR7 Main Galaxy Sample I: A 4 per cent Distance Measure at z=0.15
• Improved Cosmological Constraints from New, Old and Combined Supernova Datasets
• WMAP constraints on low redshift evolution of dark energy
• Hubble parameter measurement constraints on the redshift of the deceleration-acceleration transition, dynamical dark energy, and space curvature
• A generalized equation of state for dark energy
• Vacuum models with a linear and a quadratic term in H: structure formation and number counts analysis
• Connecting early and late epochs by f(z)CDM cosmography
• Cosmography approach to dark energy cosmologies: new constrains using the Hubble diagrams of supernovae, quasars and gamma-ray bursts
• The LambdaCDM model on the lead -- a Bayesian cosmological models comparison
• A Bayesian comparison between $\Lambda$CDM and phenomenologically emergent dark energy models
• Agegraphic dark energy: growth index and cosmological implications
• Is the Dynamics of Tracking Dark Energy Detectable?
• Should we doubt the cosmological constant?
• Observational constraints on the oscillating dark energy cosmologies
• Spherical collapse model in agegraphic dark energy cosmologies
• Comment on "Bayesian Analysis of Pentaquark Signals from CLAS Data", with Response to the Reply by Ireland and Protopopsecu
• Structure formation in dark energy cosmologies described by PADE parameterization
• Cross-Validation, Risk Estimation, and Model Selection
• The Combinatorics of Occam's Razor