Matrix-free Large Scale Bayesian inference in cosmology
arXiv:1402.1763 · doi:10.1093/mnras/stu2479
Abstract
In this work we propose a new matrix-free implementation of the Wiener sampler which is traditionally applied to high dimensional analysis when signal covariances are unknown. Specifically, the proposed method addresses the problem of jointly inferring a high dimensional signal and its corresponding covariance matrix from a set of observations. Our method implements a Gibbs sampling adaptation of the previously presented messenger approach, permitting to cast the complex multivariate inference problem into a sequence of uni-variate random processes. In this fashion, the traditional requirement of inverting high dimensional matrices is completely eliminated from the inference process, resulting in an efficient algorithm that is trivial to implement. Using cosmic large scale structure data as a showcase, we demonstrate the capabilities of our Gibbs sampling approach by performing a joint analysis of three dimensional density fields and corresponding power-spectra from Gaussian mock catalogues. These tests clearly demonstrate the ability of the algorithm to accurately provide measurements of the three dimensional density field and its power-spectrum and corresponding uncertainty quantification. Moreover, these tests reveal excellent numerical and statistical efficiency which will generally render the proposed algorithm a valuable addition to the toolbox of large scale Bayesian inference in cosmology and astrophysics.
arXiv comment9 pages, 2 figures, submitted to MNRAS
References in corpus (31)
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- The Seventh Data Release of the Sloan Digital Sky Survey
- Baryonic Features in the Matter Transfer Function
- Power Spectra for Cold Dark Matter and its Variants
- Detection of Gravitational Lensing in the Cosmic Microwave Background
- An improved map of the Galactic Faraday sky
- Wiener Reconstruction of The Large Scale Structure
- Global, Exact Cosmic Microwave Background Data Analysis Using Gibbs Sampling
- Power spectrum estimation from high-resolution maps by Gibbs sampling
- Methods for Rapidly Processing Angular Masks of Next-Generation Galaxy Surveys
- Reconstructed Density and Velocity Fields from the 2MASS Redshift Survey
- A Spherical Harmonic Approach to Redshift Distortion and a Measurement of Omega from the 1.2 Jy IRAS Redshift Survey
- Application of Monte Carlo Algorithms to the Bayesian Analysis of the Cosmic Microwave Background
- Wiener Reconstruction of Large-Scale Structure from Peculiar Velocities
- Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization
- Wiener Reconstruction of Density, Velocity, and Potential Fields from All-Sky Galaxy Redshift Surveys
- Bayesian power-spectrum inference for Large Scale Structure data
- The 2dF Galaxy Redshift Survey: Wiener Reconstruction of the Cosmic Web
- Wiener Reconstruction of Galaxy Surveys in Spherical Harmonics
- NIFTY - Numerical Information Field Theory - a versatile Python library for signal inference
- Cosmic Cartography of the Large-Scale Structure with Sloan Digital Sky Survey Data Release 6
- Bayesian Power Spectrum Analysis of the First-Year WMAP data
- Estimation of Polarized Power Spectra by Gibbs sampling
- Efficient Wiener filtering without preconditioning
- Methods for Bayesian power spectrum inference with galaxy surveys
- A Markov Chain Monte Carlo Algorithm for analysis of low signal-to-noise CMB data
- Bayesian analysis of the low-resolution polarized 3-year WMAP sky maps
- Unbiased Reconstruction of the Large Scale Structure
- Probabilistic image reconstruction for radio interferometers
- Optimal Image Reconstruction in Radio Interferometry
- Constrained realizations and minimum variance reconstruction of non-Gaussian random fields
Cited by in corpus (27)
- Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
- Dark Energy Survey Year 3 results: curved-sky weak lensing mass map reconstruction
- Unmasking the Masked Universe: the 2M++ catalogue through Bayesian eyes
- Hierarchical Cosmic Shear Power Spectrum Inference
- Bayesian optimisation for likelihood-free cosmological inference
- Cosmological parameters, shear maps and power spectra from CFHTLenS using Bayesian hierarchical inference
- Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
- Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- Field Level Neural Network Emulator for Cosmological N-body Simulations
- Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
- Bayesian inference of CMB gravitational lensing
- A new approach for the statistical denoising of Planck interstellar dust polarization data
- Weak lensing mass reconstruction using sparsity and a Gaussian random field
- Wiener filter reloaded: fast signal reconstruction without preconditioning
- Field-level inference of galaxy intrinsic alignment from the SDSS-III BOSS survey
- Primordial power spectrum and cosmology from black-box galaxy surveys
- Wiener filtering and pure E/B decomposition of CMB maps with anisotropic correlated noise
- Bayesian power-spectrum inference with foreground and target contamination treatment
- Fast Sampling from Wiener Posteriors for Image Data with Dataflow Engines
- Cosmological Parameters from CMB Maps without Likelihood Approximation
- Optimal and fast E/B separation with a dual messenger field
- Testing self-interacting dark matter with galaxy warps
- Cosmic Microwave Background Mapmaking with a Messenger Field
- Field-level multiprobe analysis of the CMB, integrated Sachs-Wolfe effect, and the galaxy density maps
- Preconditioner-free Wiener filtering with a dense noise matrix
- Halo detection via large-scale Bayesian inference