Bayesian vs Frequentist: Comparing Bayesian model selection with a frequentist approach using the iterative smoothing method

Abstract

We have developed a frequentist approach for model selection which determines the consistency between any cosmological model and the data using the distribution of likelihoods from the iterative smoothing method. Using this approach, we have shown how confidently we can conclude whether the data support any given model without comparison to a different one. In this current work, we compare our approach with the conventional Bayesian approach based on the estimation of the Bayesian evidence using nested sampling. We use simulated future Roman (formerly WFIRST)-like type Ia supernovae data in our analysis. We discuss the limits of the Bayesian approach for model selection and show how our proposed frequentist approach can perform better in the falsification of individual models. Namely, if the true model is among the candidates being tested in the Bayesian approach, that approach can select the correct model. If all of the options are false, then the Bayesian approach will select merely the least incorrect one. Our approach is designed for such a case and we can conclude that all of the models are false.

arXiv comment12 pages, 3 figures, 3 tables

References in corpus (30)

• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
• Improved cosmological constraints from a joint analysis of the SDSS-II and SNLS supernova samples
• New Hubble Space Telescope Discoveries of Type Ia Supernovae at z > 1: Narrowing Constraints on the Early Behavior of Dark Energy
• The Hubble Space Telescope Cluster Supernova Survey: V. Improving the Dark Energy Constraints Above z>1 and Building an Early-Type-Hosted Supernova Sample
• Improved Cosmological Constraints from New, Old and Combined Supernova Datasets
• Spectra and Light Curves of Six Type Ia Supernovae at 0.511 < z < 1.12 and the Union2 Compilation
• Wide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report
• Improved Dark Energy Constraints from ~100 New CfA Supernova Type Ia Light Curves
• Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
• A Simple Phenomenological Emergent Dark Energy Model can Resolve the Hubble Tension
• Smoothing Supernova Data to Reconstruct the Expansion History of the Universe and its Age
• Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology?
• On Correlated-noise Analyses Applied To Exoplanet Light Curves
• Model independent tests of the standard cosmological model
• Wide-Field InfraRed Survey Telescope (WFIRST) Final Report
• Model Independent Reconstruction of the Expansion History of the Universe and the Properties of Dark Energy
• Implications of a transition in the dark energy equation of state for the $H_0$ and ${\sigma }_8$ tensions
• Evidence for Emergent Dark Energy
• Model-independent test of the FLRW metric, the flatness of the Universe, and non-local measurement of $H_0{r}_{\mathrm{d}}$
• Falsifying $\Lambda$CDM: Model-independent tests of the concordance model with eBOSS DR14Q and Pantheon
• Testing the Mutual Consistency of the Pantheon and SDSS/eBOSS BAO Data Sets with Gaussian Processes
• Model-independent cosmological constraints from growth and expansion
• Model Independent Expansion History from Supernovae: Cosmology versus Systematics
• Model-independent constraints on Type Ia supernova light-curve hyper-parameters and reconstructions of the expansion history of the Universe
• Model selection and parameter estimation using the iterative smoothing method