Matrix-free Large Scale Bayesian inference in cosmology

Abstract

In this work we propose a new matrix-free implementation of the Wiener sampler which is traditionally applied to high dimensional analysis when signal covariances are unknown. Specifically, the proposed method addresses the problem of jointly inferring a high dimensional signal and its corresponding covariance matrix from a set of observations. Our method implements a Gibbs sampling adaptation of the previously presented messenger approach, permitting to cast the complex multivariate inference problem into a sequence of uni-variate random processes. In this fashion, the traditional requirement of inverting high dimensional matrices is completely eliminated from the inference process, resulting in an efficient algorithm that is trivial to implement. Using cosmic large scale structure data as a showcase, we demonstrate the capabilities of our Gibbs sampling approach by performing a joint analysis of three dimensional density fields and corresponding power-spectra from Gaussian mock catalogues. These tests clearly demonstrate the ability of the algorithm to accurately provide measurements of the three dimensional density field and its power-spectrum and corresponding uncertainty quantification. Moreover, these tests reveal excellent numerical and statistical efficiency which will generally render the proposed algorithm a valuable addition to the toolbox of large scale Bayesian inference in cosmology and astrophysics.

9 pages, 2 figures, submitted to MNRAS

References in corpus (9)

• Detection of Gravitational Lensing in the Cosmic Microwave Background
• Methods for Rapidly Processing Angular Masks of Next-Generation Galaxy Surveys
• Reconstructed Density and Velocity Fields from the 2MASS Redshift Survey
• Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization
• Estimation of Polarized Power Spectra by Gibbs sampling
• Efficient Wiener filtering without preconditioning
• Methods for Bayesian power spectrum inference with galaxy surveys
• Probabilistic image reconstruction for radio interferometers
• Optimal Image Reconstruction in Radio Interferometry

Cited by in corpus (27)

• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• Dark Energy Survey Year 3 results: curved-sky weak lensing mass map reconstruction
• Unmasking the Masked Universe: the 2M++ catalogue through Bayesian eyes
• Hierarchical Cosmic Shear Power Spectrum Inference
• Bayesian optimisation for likelihood-free cosmological inference
• Cosmological parameters, shear maps and power spectra from CFHTLenS using Bayesian hierarchical inference
• Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
• Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV
• The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
• Field Level Neural Network Emulator for Cosmological N-body Simulations
• Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
• Bayesian inference of CMB gravitational lensing
• A new approach for the statistical denoising of Planck interstellar dust polarization data
• Weak lensing mass reconstruction using sparsity and a Gaussian random field
• Wiener filter reloaded: fast signal reconstruction without preconditioning
• Field-level inference of galaxy intrinsic alignment from the SDSS-III BOSS survey
• Primordial power spectrum and cosmology from black-box galaxy surveys
• Wiener filtering and pure E/B decomposition of CMB maps with anisotropic correlated noise
• Bayesian power-spectrum inference with foreground and target contamination treatment
• Fast Sampling from Wiener Posteriors for Image Data with Dataflow Engines
• Cosmological Parameters from CMB Maps without Likelihood Approximation
• Optimal and fast E/B separation with a dual messenger field
• Testing self-interacting dark matter with galaxy warps
• Cosmic Microwave Background Mapmaking with a Messenger Field
• Field-level multiprobe analysis of the CMB, integrated Sachs-Wolfe effect, and the galaxy density maps
• Preconditioner-free Wiener filtering with a dense noise matrix
• Halo detection via large-scale Bayesian inference