Calibrating Bayesian Tension Statistics using Neural Ratio Estimation
arXiv:2407.15478 · doi:10.1103/47hn-h8kc
Abstract
When fits of the same physical model to two different datasets disagree, we call this tension. Several apparent tensions in cosmology have occupied researchers in recent years, and a number of different metrics have been proposed to quantify tension. Many of these metrics suffer from limiting assumptions, and correctly calibrating these is essential if we want to successfully determine whether discrepancies are significant. A commonly used metric of tension is the evidence ratio R. The statistic has been widely adopted by the community as a Bayesian way of quantifying tensions, however, it has a non-trivial dependence on the prior that is not always accounted for properly. We show that this can be calibrated out effectively with Neural Ratio Estimation. We demonstrate our proposed calibration technique with an analytic example, a toy example inspired by 21-cm cosmology, and with observations of the Baryon Acoustic Oscillations from the Dark Energy Spectroscopic Instrument (DESI) and the Sloan Digital Sky Survey (SDSS). We find no significant tension between DESI and SDSS.
Updated to be in line with the journal
References in corpus (48)
- emcee: The MCMC Hammer
- The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
- Cosmology at Low Frequencies: The 21 cm Transition and the High-Redshift Universe
- The Sixteenth Data Release of the Sloan Digital Sky Surveys: First Release from the APOGEE-2 Southern Survey and Full Release of eBOSS Spectra
- Bayes in the sky: Bayesian inference and model selection in cosmology
- Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- An absorption profile centred at 78 megahertz in the sky-averaged spectrum
- DESI 2024 VI: Cosmological Constraints from the Measurements of Baryon Acoustic Oscillations
- 21cmFAST: A Fast, Semi-Numerical Simulation of the High-Redshift 21-cm Signal
- The Hubble Hunter's Guide
- PolyChord: nested sampling for cosmology
- PolyChord: next-generation nested sampling
- Curvature tension: evidence for a closed universe
- Applications of Bayesian model selection to cosmological parameters
- DESI 2024 III: Baryon Acoustic Oscillations from Galaxies and Quasars
- DESI 2024 IV: Baryon Acoustic Oscillations from the Lyman Alpha Forest
- Concerns about Modelling of the EDGES Data
- Data Analysis for Precision 21 cm Cosmology
- Concordance and Discordance in Cosmology
- Baryon Acoustic Oscillations and the Hubble Constant: Past, Present and Future
- A non-linear solution to the tension?
- Tension between the power spectrum of density perturbations measured on large and small scales
- DES Y3 + KiDS-1000: Consistent cosmology combining cosmic shear surveys
- Nested sampling for physical scientists
- Testing for calibration systematics in the EDGES low-band data using Bayesian model selection
- The redshifted 21-cm signal in the EDGES low-band spectrum
- The Rise of the First Stars: Supersonic Streaming, Radiative Feedback, and 21-cm Cosmology
- Quantifying tensions in cosmological parameters: Interpreting the DES evidence ratio
- The REACH radiometer for detecting the 21-cm hydrogen signal from redshift 7.5 to 28
- Bayesian evidence as a tool for comparing datasets
- Decoding the X-ray Properties of Pre-Reionization Era Sources
- High-redshift radio galaxies: a potential new source of 21-cm fluctuations
- Assessing tension metrics with Dark Energy Survey and Planck data
- The subtlety of Ly-a photons: changing the expected range of the 21-cm signal
- A General Bayesian Framework for Foreground Modelling and Chromaticity Correction for Global 21cm Experiments
- Non-Gaussian estimates of tensions in cosmological parameters
- maxsmooth: Rapid Maximally Smooth Function Fitting With Applications in Global 21-cm Cosmology
- Quantifying concordance of correlated cosmological data sets
- Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
- An Effective Model for the Cosmic-Dawn 21-cm Signal
- Planck confronts large scale structure: methods to quantify discordance
- Impact of the Primordial Stellar Initial Mass Function on the 21-cm Signal
- Quantifying Concordance in Cosmology
- Concordance Cosmology?
- Cosmoglobe DR1 results. I. Improved Wilkinson Microwave Anisotropy Probe maps through Bayesian end-to-end analysis
- On dataset tensions and signatures of new cosmological physics
- Bayesian evidence estimation from posterior samples with normalizing flows
- SIDE-real: Supernova Ia Dust Extinction with truncated marginal neural ratio estimation applied to real data