The reliability of the AIC method in Cosmological Model Selection

Abstract

The Akaike information criterion (AIC) has been used as a statistical criterion to compare the appropriateness of different dark energy candidate models underlying a particular data set. Under suitable conditions, the AIC is an indirect estimate of the Kullback-Leibler divergence D(T//A) of a candidate model A with respect to the truth T. Thus, a dark energy model with a smaller AIC is ranked as a better model, since it has a smaller Kullback-Leibler discrepancy with T. In this paper, we explore the impact of statistical errors in estimating the AIC during model comparison. Using a parametric bootstrap technique, we study the distribution of AIC differences between a set of candidate models due to different realizations of noise in the data and show that the shape and spread of this distribution can be quite varied. We also study the rate of success of the AIC procedure for different values of a threshold parameter popularly used in the literature. For plausible choices of true dark energy models, our studies suggest that investigating such distributions of AIC differences in addition to the threshold is useful in correctly interpreting comparisons of dark energy models using the AIC technique.

Figures and further discussions of the results were added, and the version matches the version published in MNRAS

References in corpus (15)

• Cosmology and the Fate of Dilatation Symmetry
• New Hubble Space Telescope Discoveries of Type Ia Supernovae at z > 1: Narrowing Constraints on the Early Behavior of Dark Energy
• Bayes in the sky: Bayesian inference and model selection in cosmology
• Observational Constraints on the Nature of the Dark Energy: First Cosmological Results from the ESSENCE Supernova Survey
• Improved Dark Energy Constraints from ~100 New CfA Supernova Type Ia Light Curves
• First-year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Hubble Diagram and Cosmological Parameters
• CfA3: 185 Type Ia Supernova Light Curves from the CfA
• Evidence for the accelerated expansion of the Universe from weak lensing tomography with COSMOS
• The WiggleZ Dark Energy Survey: testing the cosmological model with baryon acoustic oscillations at z=0.6
• First-Year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Constraints on Non-Standard Cosmological Models
• The Carnegie Supernova Project: First Near-Infrared Hubble Diagram to z~0.7
• Top ten accelerating cosmological models
• Present and future evidence for evolving dark energy
• Lorentz Invariance Violation induced time delays in GRBs in different cosmological models
• Designing Decisive Detections

Cited by in corpus (31)

• Dark sector interaction: a remedy of the tensions between CMB and LSS data
• Cosmic Chronometers in the R_h=ct Universe
• Dark sector interaction and the supernova absolute magnitude tension
• Measurements of $H_0$ in modified gravity theories: The role of lensed quasars in the late-time Universe
• The Gamma-Ray Burst Hubble Diagram and Its Cosmological Implications
• Cosmological Tests Using GRBs, the Star Formation Rate and Possible Abundance Evolution
• Classification of Gamma-Ray Burst durations using robust model-comparison techniques
• Structured ionized winds shooting out from a quasar at relativistic speeds
• Cosmological test using the Hubble diagram of high-z quasars
• Observational Constraints and Cosmological Implications of Scalar-Tensor $f(R,T)$ Gravity
• A Test of Cosmological Models using high-z Measurements of H(z)
• Impact of young stellar components on quiescent galaxies: deconstructing cosmic chronometers
• The High-z Quasar Hubble Diagram
• Impact of a locally measured H_0 on the interpretation of cosmic chronometer data
• X-ray absorption towards high-redshift sources: probing the intergalactic medium with blazars
• Testing the warmness of dark matter
• A thorough investigation of the prospects of eLISA in addressing the Hubble tension: Fisher Forecast, MCMC and Machine Learning
• Testing Cosmological Models with Type Ic Super Luminous Supernovae
• Transit cosmological models in Myrzakulov F(R,T) gravity theory
• Diagnostic and Comparative Analysis of Dark Energy Models with $q(z)$ Parametrizations
• Density Jumps Near the Virial Radius of Galaxy Clusters
• Constancy of the Cluster Gas Mass Fraction in the R_h=ct Universe
• Length-preserving biconnection gravity and its cosmological implications
• Effects of anisotropy in an anisotropic extension of $w$CDM model
• The AGN Hubble Diagram and Its Implications for Cosmology
• Spectral Evolution of Ultraluminous X-ray Pulsar NGC 300 ULX-1
• From Barthel Randers Kropina Geometries to the Accelerating Universe: A Brief Review of Recent Advances in Finslerian Cosmology
• Observational tests of the conformal osculating Barthel-Kropina cosmological model
• Model selection using time-delay lenses
• Geometric formulation of $k$-essence and late-time acceleration
• Constraints on the Modified Emergent Dark Energy Model Using DESI DR2 BAO