Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates

Abstract

Predictions of the mean and covariance matrix of summary statistics are critical for confronting cosmological theories with observations, not least for likelihood approximations and parameter inference. The price to pay for accurate estimates is the extreme cost of running $N$-body and hydrodynamics simulations. Approximate solvers, or surrogates, greatly reduce the computational cost but can introduce significant biases, for example in the non-linear regime of cosmic structure growth. We propose "CARPool Bayes", an approach to solve the inference problem for both the means and covariances using a combination of simulations and surrogates. Our framework allows incorporating prior information for the mean and covariance. We derive closed-form solutions for Maximum A Posteriori covariance estimates that are efficient Bayesian shrinkage estimators, guarantee positive semi-definiteness, and can optionally leverage analytical covariance approximations. We discuss choices of the prior and propose a simple procedure for obtaining optimal prior hyperparameter values with a small set of test simulations. We test our method by estimating the covariances of clustering statistics of GADGET-III $N$-body simulations at redshift $z=0.5$ using surrogates from a 100-1000$\times$ faster particle-mesh code. Taking the sample covariance from 15,000 simulations as the truth, and using an empirical Bayes prior with diagonal blocks, our estimator produces nearly identical Fisher matrix contours for $\Lambda$CDM parameters using only $15$ simulations of the non-linear dark matter power spectrum. In this case the number of simulations is so small that the sample covariance would be degenerate. We show cases where even with a naïve prior our method still improves the estimate. Our framework is applicable to a wide range of cosmological and astrophysical problems where fast surrogates are available.

19 pages, 12 Figures

References in corpus (29)

• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations
• AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
• The BACCO Simulation Project: Exploiting the full power of large-scale structure for cosmology
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• Simulations of Baryon Acoustic Oscillations II: Covariance matrix of the matter power spectrum
• Cosmological constraints from BOSS with analytic covariance matrices
• Analytic model for the matter power spectrum, its covariance matrix, and baryonic effects
• Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
• Shrinkage Estimation of the Power Spectrum Covariance Matrix
• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
• Perturbative approach to covariance matrix of the matter power spectrum
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Matter Power Spectrum Covariance Matrix from the DEUS-PUR ΛCDM simulations: Mass Resolution and non-Gaussian Errors
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
• An emulator for the Lyman-$\alpha$ forest in beyond-$\Lambda$CDM cosmologies
• Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
• General framework for cosmological dark matter bounds using $N$-body simulations
• Non-linear shrinkage estimation of large-scale structure covariance
• Estimating Covariance Matrices for Two- and Three-Point Correlation Function Moments in Arbitrary Survey Geometries
• AMICO galaxy clusters in KiDS-DR3: cosmological constraints from large-scale stacked weak lensing profiles
• CARPool Covariance: Fast, unbiased covariance estimation for large-scale structure observables
• The DESI $N$-body Simulation Project -- II. Suppressing sample variance with fast simulations
• Does jackknife scale really matter for accurate large-scale structure covariances?
• Covariance of the redshift-space matter power spectrum after reconstruction
• Reducing the Variance of Redshift Space Distortion Measurements from Mock Galaxy Catalogues with Different Lines of Sight
• Perfectly parallel cosmological simulations using spatial comoving Lagrangian acceleration

Cited by in corpus (4)

• Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation
• Precision Redshift-Space Galaxy Power Spectra using Zel'dovich Control Variates
• Quijote-PNG: Quasi-maximum likelihood estimation of Primordial Non-Gaussianity in the non-linear dark matter density field
• Quijote-PNG: Quasi-maximum likelihood estimation of Primordial Non-Gaussianity in the non-linear halo density field