Bayesian evidence as a tool for comparing datasets

Abstract

We introduce a new conservative test for quantifying the consistency of two or more datasets. The test is based on the Bayesian answer to the question, ``How much more probable is it that all my data were generated from the same model system than if each dataset were generated from an independent set of model parameters?''. We make explicit the connection between evidence ratios and the differences in peak chi-squared values, the latter of which are more widely used and more cheaply calculated. Calculating evidence ratios for three cosmological datasets (recent CMB data (WMAP, ACBAR, CBI, VSA), SDSS and the most recent SNe Type 1A data) we find that concordance is favoured and the tightening of constraints on cosmological parameters is indeed justified.

4 pages, accepted by Phys. Rev. D

References in corpus (1)

• Bayesian model selection and isocurvature perturbations

Cited by in corpus (81)

• Bayes in the sky: Bayesian inference and model selection in cosmology
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• H0LiCOW XIII. A 2.4% measurement of $H_0$ from lensed quasars: $5.3\sigma$ tension between early and late-Universe probes
• Dark Energy
• Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
• H0LiCOW V. New COSMOGRAIL time delays of HE0435-1223: $H_0$ to 3.8% precision from strong lensing in a flat $\Lambda$CDM model
• Curvature tension: evidence for a closed universe
• Applications of Bayesian model selection to cosmological parameters
• Dark energy two decades after: Observables, probes, consistency tests
• Multi-system Bayesian constraints on the transport coefficients of QCD matter
• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
• Hubble Space Telescope Combined Strong and Weak Lensing Analysis of the CLASH Sample: Mass and Magnification Models and Systematic Uncertainties
• CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
• Concordance and Discordance in Cosmology
• Prospects for resolving the Hubble constant tension with standard sirens
• Cosmic Microwave Weak lensing data as a test for the dark universe
• KiDS-450: Testing extensions to the standard cosmological model
• Baryon Acoustic Oscillations and the Hubble Constant: Past, Present and Future
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• Fitting the Phenomenological MSSM
• Quantifying tensions in cosmological parameters: Interpreting the DES evidence ratio
• Top ten accelerating cosmological models
• Early recombination as a solution to the $H_0$ tension
• Features of holographic dark energy under the combined cosmological constraints
• Bayesian Selection of sign(mu) within mSUGRA in Global Fits Including WMAP5 Results
• Dark Energy Survey Year 1 Results: Constraints on Intrinsic Alignments and their Colour Dependence from Galaxy Clustering and Weak Lensing
• Finding Evidence for Massive Neutrinos using 3D Weak Lensing
• Bayesian Evidence and Model Selection
• Unraveling the effective fluid approach for $f(R)$ models in the subhorizon approximation
• Assessing tension metrics with Dark Energy Survey and Planck data
• Quantifying the global parameter tensions between ACT, SPT and Planck
• Cosmological discordances II: Hubble constant, Planck and large-scale-structure data sets
• Is there concordance within the concordance $\Lambda$CDM model?
• Cosmological discordances: a new measure, marginalization effects, and application to geometry vs growth current data sets
• COSMOGRAIL XVII: Time delays for the quadruply imaged quasar PG 1115+080
• Non-Gaussian estimates of tensions in cosmological parameters
• Bayesian analysis of Friedmannless cosmologies
• Forecasting the Bayes factor of a future observation
• Dark Energy Survey Year 1 Results: Joint Analysis of Galaxy Clustering, Galaxy Lensing, and CMB Lensing Two-point Functions
• Quantifying concordance of correlated cosmological data sets
• H0LiCOW VIII. A weak lensing measurement of the external convergence in the field of the lensed quasar HE0435$-$1223
• A Unified Analysis of Four Cosmic Shear Surveys
• Compatibility of Planck and BICEP2 in the Light of Inflation
• Bayesian optimal reconstruction of the primordial power spectrum
• Bayesian reconstruction of the Milky Way dark matter distribution
• Advances in Constraining Intrinsic Alignment Models with Hydrodynamic Simulations
• Testing the consistency between cosmological data: the impact of spatial curvature and the dark energy EoS
• COSMOGRAIL XVIII: time delays of the quadruply lensed quasar WFI2033-4723
• Planck confronts large scale structure: methods to quantify discordance
• Quantifying Tensions between CMB and Distance Datasets in Models with Free Curvature or Lensing Amplitude
• Consistency tests in cosmology using relative entropy
• Testing Gravity on Cosmic Scales: A Case Study of Jordan-Brans-Dicke Theory
• Robust sampling for weak lensing and clustering analyses with the Dark Energy Survey
• A Bayesian interpretation of inconsistency measures in cosmology
• Quantifying Suspiciousness Within Correlated Data Sets
• Dark Energy Survey internal consistency tests of the joint cosmological probes analysis with posterior predictive distributions
• Quantifying Concordance in Cosmology
• Conservative cosmology: combining data with allowance for unknown systematics
• Inference of Experimental Radial Impurity Transport on Alcator C-Mod: Bayesian Parameter Estimation and Model Selection
• Neutrino masses from clustering of red and blue galaxies: a test of astrophysical uncertainties
• Constraining spatial curvature with large-scale structure
• Statistical tests of sterile neutrinos using cosmology and short-baseline data
• A new measure of tension between experiments
• A Bayesian quantification of consistency in correlated datasets
• H0LiCOW XI. A weak lensing measurement of the external convergence in the field of the lensed quasar B1608+656 using HST and Subaru deep imaging
• Hubble WFC3 Spectroscopy of the Terrestrial Planets L~98-59~c \& d: No Evidence for a Clear Hydrogen Dominated Primary Atmosphere
• Cosmological discordances III: more on measure properties, Large-Scale-Structure constraints, the Hubble constant and Planck
• The dependence of subhalo abundance matching on galaxy photometry and selection criteria
• Testing the mutual consistency of different supernovae surveys
• When tension is just a fluctuation: How noisy data affect model comparison
• On dataset tensions and signatures of new cosmological physics
• Interpreting Internal Consistency of DES Measurements
• Cosmic dipole tensions: confronting the cosmic microwave background with infrared and radio populations of cosmological sources
• Constraining Cosmology With the CMB $\times$ LIM-Nulling Convergence
• One Extension to Explain Them All, One Scale-Invariant Spectrum to Test Them All, and in One Model Bind Them
• Cosmic microwave background constraints on cosmological models with large-scale isotropy breaking
• Quantifying the Quark Gluon Plasma
• Bayesian Inversion of Stokes Profiles
• Bayesian evidence and model selection approach for time-dependent dark energy
• Calibrating Bayesian Tension Statistics using Neural Ratio Estimation