Debiasing inference with approximate covariance matrices and other unidentified biases
arXiv:1902.00709 · doi:10.1088/1475-7516/2019/08/021
Abstract
When a posterior peaks in unexpected regions of parameter space, new physics has either been discovered, or a bias has not been identified yet. To tell these two cases apart is of paramount importance. We therefore present a method to indicate and mitigate unrecognized biases: Our method runs any pipeline with possibly unknown biases on both simulations and real data. It computes the coverage probability of posteriors, which measures whether posterior volume is a faithful representation of probability or not. If found to be necessary, the posterior is then corrected. This is a non-parametric debiasing procedure which complies with objective Bayesian inference. We use the method to debias inference with approximate covariance matrices and redshift uncertainties. We demonstrate why approximate covariance matrices bias physical constraints, and how this bias can be mitigated. We show that for a Euclid-like survey, if a traditional likelihood exists, then 25 end-to-end simulations suffice to guarantee that the figure of merit deteriorates maximally by 22 percent, or by 10 percent for 225 simulations. Thus, even a pessimistic analysis of Euclid-like data will still constitute an 25-fold increase in precision on the dark energy parameters in comparison to the state of the art (2018) set by KiDS and DES. We provide a public code of our method.
References in corpus (30)
- Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
- Measurements of Omega and Lambda from 42 High-Redshift Supernovae
- Planck 2015 results. XIII. Cosmological parameters
- Weak Gravitational Lensing
- The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
- Stable clustering, the halo model and nonlinear cosmological power spectra
- Halo Models of Large Scale Structure
- Revising the Halofit Model for the Nonlinear Matter Power Spectrum
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- Cosmology and Fundamental Physics with the Euclid Satellite
- Karhunen-Loeve eigenvalue problems in cosmology: how should we tackle large data sets?
- Dark Energy Survey Year 1 Results: Cosmological Constraints from Cosmic Shear
- Cosmology with cosmic shear observations: a review
- Gravitational Lensing Analysis of the Kilo Degree Survey
- Parameter inference with estimated covariance matrices
- KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
- Putting the Precision in Precision Cosmology: How accurate should your data covariance matrix be?
- Survey geometry and the internal consistency of recent cosmic shear measurements
- Estimating Cosmological Parameter Covariance
- Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
- Simulations of Weak Gravitational Lensing - II : Including Finite Support Effects in Cosmic Shear Covariance Matrices
- Information content in the halo-model dark-matter power spectrum
- On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- Objective Bayesian analysis of neutrino masses and hierarchy
- Quantifying lost information due to covariance matrix estimation in parameter inference
- DES Y1 Results: Validating cosmological parameter estimation using simulated Dark Energy Surveys
- Likelihood Non-Gaussianity in Large-Scale Structure Analyses
- Covariance of the galaxy angular power spectrum with the halo model
- Inadequacy of internal covariance estimation for super-sample covariance
Cited by in corpus (15)
- Euclid: The reduced shear approximation and magnification bias for Stage IV cosmic shear experiments
- Beyond two-point statistics: using the minimum spanning tree as a tool for cosmology
- A blinding solution for inference from astronomical data
- Flow-Based Likelihoods for Non-Gaussian Inference
- Post-Limber Weak Lensing Bispectrum, Reduced Shear Correction, and Magnification Bias Correction
- A new approach to modelling gamma-ray burst afterglows: Using Gaussian processes to account for the systematics
- The impact of braiding covariance and in-survey covariance on next-generation galaxy surveys
- Forecasting constraints on the mean free path of ionizing photons at from the Lyman- forest flux auto-correlation function
- Efficient computation of the super-sample covariance for stage IV galaxy surveys
- Accessing the high- frontier under the Reduced Shear Approximation with -cut Cosmic Shear
- Gaussian Mixture Models for Blended Photometric Redshifts
- Cosmological inference including massive neutrinos from the matter power spectrum: biases induced by uncertainties in the covariance matrix
- On the Robustness of Cluster Clustering Covariance Calibration
- Efficient neutral-IGM inference from noisy 21-cm forest spectra with latent-space U-Net encoding and XGBoost
- Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix