Comparison between different methods of model selection in cosmology

Abstract

There are several methods for model selection in cosmology which have at least two major goals, that of finding the correct model or predicting well. In this work we discuss through a study of well-known model selection methods like Akaike information criterion (AIC), Bayesian information criterion (BIC), deviance information criterion (DIC) and Bayesian evidence, how these different goals are pursued in each paradigm. We also apply another method for model selection which less seen in cosmological literature, the Cross-validation method. Using these methods we will compare two different scenarios in cosmology, $\Lambda$CDM model and dynamical dark energy. We show that each of the methods tends to different results in model selection. While BIC and Bayesian evidence overrule the dynamical dark energy scenarios with 2 or 3 extra degree of freedom, the DIC and cross-validation method prefer these dynamical models to $\Lambda$CDM model. Assuming the numerical results of different analysis and combining cosmological and statistical aspects of the subject, we propose cross-validation as an interesting method for model selection in cosmology that can lead to different results in comparison with usual methods of model selection.

12 pages, 3 figures, PUBLISHED IN EPJP. arXiv admin note: text overlap with arXiv:1510.00547 by other authors

References in corpus (62)

• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Determination of Cosmological Parameters
• Dynamics of dark energy
• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• Unified cosmic history in modified gravity: from F(R) theory to Lorentz non-invariant models
• Type Ia Supernova Discoveries at z>1 From the Hubble Space Telescope: Evidence for Past Deceleration and Constraints on Dark Energy Evolution
• A survey of cross-validation procedures for model selection
• A Phantom Menace? Cosmological consequences of a dark energy component with super-negative equation of state
• Cosmological Constant - the Weight of the Vacuum
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
• The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
• The 6dF Galaxy Survey: Baryon Acoustic Oscillations and the Local Hubble Constant
• Is Cosmic Speed-Up Due to New Gravitational Physics?
• Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
• Essentials of k-essence
• The Clustering of the SDSS DR7 Main Galaxy Sample I: A 4 per cent Distance Measure at z=0.15
• Improved Cosmological Constraints from New, Old and Combined Supernova Datasets
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Implications for Inflation
• Information criteria for astrophysical model selection
• Accelerated expansion of the universe driven by tachyonic matter
• Late-time cosmology in (phantom) scalar-tensor theory: dark energy and the cosmic speed-up
• The Hubble Hunter's Guide
• Quintessence as a run-away dilaton
• Measurement of BAO correlations at $z=2.3$ with SDSS DR12 \lya-Forests
• WMAP constraints on low redshift evolution of dark energy
• Hubble parameter measurement constraints on the redshift of the deceleration-acceleration transition, dynamical dark energy, and space curvature
• A Lower Growth Rate from Recent Redshift Space Distortion Measurements than Expected from Planck
• Constraining the equation of state of the Universe from Distant Type Ia Supernovae and Cosmic Microwave Background Anisotropies
• Limitations in using luminosity distance to determine the equation of state of the universe
• Measuring the Speed of Sound of Quintessence
• Tension with the flat ΛCDM model from a high redshift Hubble Diagram of supernovae, quasars and gamma-ray bursts
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: structure growth rate measurement from the anisotropic quasar power spectrum in the redshift range $0.8<z<2.2$
• Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology?
• Cosmography and flat $\Lambda$CDM tensions at high redshift
• Quasar X-ray and UV flux, baryon acoustic oscillation, and Hubble parameter measurement constraints on cosmological model parameters
• Vacuum models with a linear and a quadratic term in H: structure formation and number counts analysis
• A generalized equation of state for dark energy
• The Theory Behind Overfitting, Cross Validation, Regularization, Bagging, and Boosting: Tutorial
• The Jeffreys-Lindley Paradox and Discovery Criteria in High Energy Physics
• Can dark energy be expressed as a power series of the Hubble parameter?
• Connecting early and late epochs by f(z)CDM cosmography
• How clustering dark energy affects matter perturbations
• AIC and BIC for cosmological interacting scenarios
• Cosmography approach to dark energy cosmologies: new constrains using the Hubble diagrams of supernovae, quasars and gamma-ray bursts
• Observational constraints on Myrzakulov gravity
• The LambdaCDM model on the lead -- a Bayesian cosmological models comparison
• A Bayesian comparison between $\Lambda$CDM and phenomenologically emergent dark energy models
• An analytical approximation of the luminosity distance in flat cosmologies with a cosmological constant
• Can Holographic dark energy models fit the observational data?
• Agegraphic dark energy: growth index and cosmological implications
• Cosmological Constraints on Higgs-Dilaton Inflation
• Is the Dynamics of Tracking Dark Energy Detectable?
• Should we doubt the cosmological constant?
• Observational constraints on the oscillating dark energy cosmologies
• Spherical collapse model in agegraphic dark energy cosmologies
• Comment on "Bayesian Analysis of Pentaquark Signals from CLAS Data", with Response to the Reply by Ireland and Protopopsecu
• Structure formation in dark energy cosmologies described by PADE parameterization
• Model Selection and Multiple Testing - A Bayesian and Empirical Bayes Overview and some New Results
• Comparison of Cross-Validation Methods for Stochastic Block Models
• Cross-Validation, Risk Estimation, and Model Selection
• The Combinatorics of Occam's Razor

Cited by in corpus (24)

• Can $f(Q)$ gravity challenge $\Lambda$CDM?
• Cosmographic parameters in model-independent approaches
• Observational Constraints and Cosmological Implications of Scalar-Tensor $f(R,T)$ Gravity
• MOG cosmology without dark matter and the cosmological constant
• $f(Q)$-gravity and neutrino physics
• Cosmological Constraints on Non-flat Exponential $f(R)$ Gravity
• A thorough investigation of the prospects of eLISA in addressing the Hubble tension: Fisher Forecast, MCMC and Machine Learning
• Running vacuum versus Holographic dark energy: a cosmographic comparison
• Transit cosmological models in Myrzakulov F(R,T) gravity theory
• Structure growth in $f(Q)$ cosmology
• Oscillating dark energy in light of the latest observations and its impact on the Hubble tension
• Diagnostic and Comparative Analysis of Dark Energy Models with $q(z)$ Parametrizations
• Cosmological Tests of $f(R,G,T)$ Dark Energy Model in FRW Universe
• Dissecting kinetically coupled quintessence: phenomenology and observational tests
• Length-preserving biconnection gravity and its cosmological implications
• Constraining Exponential f(Q) Gravity with Cosmic Chronometers and Supernovae: A Data-Driven Analysis
• Investigating the $w$CDM Model with Latest DESI BAO Observations
• Beyond $\Lambda$CDM: Exploring a Dynamical Cosmological Constant Framework Consistent with Late-Time Observations
• Bias of reconstructing the dark energy equation of state from the Pad$\acute{e}$ cosmography
• Is Dark Energy Changing? Probing the Universe's Expansion with present and future astronomical probes
• Assessing the Robustness of the CPL Parametrization to Basis and Prior Variations: Insights from DESI DR2 BAO Data
• Dark Energy After DESI DR2: Observational Status, Reconstructions, and Physical Models
• Cosmological Dynamics of Exponential Quintessence Constrained by BAO, Cosmic Chronometers, and DES-SN5YR/Pantheon+ Data
• Geometric formulation of $k$-essence and late-time acceleration