Fast Hamiltonian sampling for large scale structure inference
arXiv:0911.2496 · doi:10.1111/j.1365-2966.2010.16897.x
Abstract
In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian lognormal Poissonian density posterior given a set of observations. The HMC allows us to take into account the nonlinear relations between the observations and the underlying density field which we seek to recover. As the HMC provides a sampled representation of the density posterior any desired statistical summary, such as the mean, mode or variance, can be calculated from the set of samples. Further, it permits us to seamlessly propagate non-Gaussian uncertainty information to any final quantity inferred from the set of samples. The developed method is extensively tested in a variety of test scenarios, taking into account a highly structured survey geometry and selection effects. Tests with a mock galaxy catalog based on the millennium run show that the method is able to recover the filamentary structure of the nonlinear density field. The results further demonstrate the feasibility of non-Gaussian sampling in high dimensional spaces, as required for precision nonlinear large scale structure inference. The HMC is a flexible and efficient method, which permits for simple extension and incorporation of additional observational constraints. Thus, the method presented here provides an efficient and flexible basis for future high precision large scale structure inference.
14 pages, 7 figures
References in corpus (5)
- Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization
- Bayesian power-spectrum inference for Large Scale Structure data
- Cosmic Cartography of the Large-Scale Structure with Sloan Digital Sky Survey Data Release 6
- Fast optimal CMB power spectrum estimation with Hamiltonian sampling
- Efficient Cosmological Parameter Estimation with Hamiltonian Monte Carlo
Cited by in corpus (86)
- Bayesian physical reconstruction of initial conditions from large scale structure surveys
- Planck 2015 results. XXI. The integrated Sachs-Wolfe effect
- ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
- Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
- Modeling Biased Tracers at the Field Level
- Past and present cosmic structure in the SDSS DR7 main sample
- The Initial Conditions of the Universe from Constrained Simulations
- Reconstructing the Cosmic Velocity and Tidal Fields with Galaxy Groups Selected from the Sloan Digital Sky Survey
- Bayesian non-linear large scale structure inference of the Sloan Digital Sky Survey data release 7
- Reconstructing the Initial Density Field of the Local Universe: Method and Test with Mock Catalogs
- Unmasking the Masked Universe: the 2M++ catalogue through Bayesian eyes
- NIFTY - Numerical Information Field Theory - a versatile Python library for signal inference
- Hierarchical Cosmic Shear Power Spectrum Inference
- A rigorous EFT-based forward model for large-scale structure
- Constraining the halo bispectrum in real and redshift space from perturbation theory and non-linear stochastic bias
- Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model
- Simulating Structure Formation of the Local Universe
- Bayesian inference of cosmic density fields from non-linear, scale-dependent, and stochastic biased tracers
- Reconstructing large-scale structure with neutral hydrogen surveys
- Bayesian analysis of the dynamic cosmic web in the SDSS galaxy survey
- Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
- Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
- Forecasts on Primordial non-Gaussianity from 21 cm Intensity Mapping experiments
- Methods for Bayesian power spectrum inference with galaxy surveys
- Multiscale Inference of Matter Fields and Baryon Acoustic Oscillations from the Ly-alpha Forest
- Bayesian inference from photometric redshift surveys
- Lifting weak lensing degeneracies with a field-based likelihood
- Inference with minimal Gibbs free energy in information field theory
- Constraining the Cosmic Baryon Distribution with Fast Radio Burst Foreground Mapping
- Mitigating contamination in LSS surveys: a comparison of methods
- COSMIC BIRTH: Efficient Bayesian Inference of the Evolving Cosmic Web from Galaxy Surveys
- Unbiased Cosmology Inference from Biased Tracers using the EFT Likelihood
- Estimating cosmic velocity fields from density fields and tidal tensors
- Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
- Matched filter optimization of kSZ measurements with a reconstructed cosmological flow field
- Dark matter voids in the SDSS galaxy survey
- Cosmology Inference from Biased Tracers using the EFT-based Likelihood
- Bayesian forward modelling of cosmic shear data
- Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
- Information Content of Higher-Order Galaxy Correlation Functions
- FLIMFLAM DR1: The First Constraints on the Cosmic Baryon Distribution from 8 FRB sightlines
- DPO - Denoising, Deconvolving, and Decomposing Photon Observations
- Inferring high redshift large-scale structure dynamics from the Lyman-alpha forest
- Machine Learning for Observational Cosmology
- Sigma-Eight at the Percent Level: The EFT Likelihood in Real Space
- Impacts of the physical data model on the forward inference of initial conditions from biased tracers
- The VIMOS Public Extragalactic Redshift Survey (VIPERS): Reconstruction of the redshift-space galaxy density field
- BIRTH of the COSMOS Field: Primordial and Evolved Density Reconstructions During Cosmic High Noon
- Bayesian estimation of our local motion from the Planck-2018 CMB temperature map
- Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
- Cosmological constraints from the power spectrum and bispectrum of 21cm intensity maps
- KaRMMa -- Kappa Reconstruction for Mass Mapping
- Probing primordial non-Gaussianity with the power spectrum and bispectrum of future 21cm intensity maps
- Explicit Bayesian treatment of unknown foreground contaminations in galaxy surveys
- The Clustering of Galaxies in the Completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmic Flows and Cosmic Web from Luminous Red Galaxies
- Cosmology with the largest galaxy cluster surveys: Going beyond Fisher matrix forecasts
- A hierarchical field-level inference approach to reconstruction from sparse Lyman- forest data
- Non-Gaussian gravitational clustering field statistics
- Bayesian cosmic density field inference from redshift space dark matter maps
- Hamiltonian Monte Carlo reconstruction from peculiar velocities
- Comparing cosmic web classifiers using information theory
- How informative are summaries of the cosmic 21-cm signal?
- BAO scale inference from biased tracers using the EFT likelihood
- Almanac: Weak Lensing power spectra and map inference on the masked sphere
- Bayesian redshift-space distortions correction from galaxy redshift surveys
- Probabilistic cosmic web classification using fast-generated training data
- Luminous giants populate the dense Cosmic Web: The radio luminosity-environmental density relation for radio galaxies in action
- Field-Based Physical Inference From Peculiar Velocity Tracers
- The Information Content of Projected Galaxy Fields
- Denoising, deconvolving and decomposing multi-domain photon observations- The D4PO algorithm
- Cosmic Cartography: Bayesian reconstruction of the galaxy density informed by large-scale structure
- Higher Order Hamiltonian Monte Carlo Sampling for Cosmological Large-Scale Structure Analysis
- Optimal machine-driven acquisition of future cosmological data
- Almanac: MCMC-based signal extraction of power spectra and maps on the sphere
- Filamentary Baryons and Where to Find Them: A forecast of synchrotron radiation from merger and accretion shocks in the local Cosmic Web
- Dynamic system classifier
- Bayesian Cosmic Web Reconstruction: BARCODE for Clusters
- Joint constraints on galaxy bias and through the N-pdf of the galaxy number density
- Bayesian large-scale structure inference and cosmic web analysis
- Straightening the Ruler: Field-Level Inference of the BAO Scale with LEFTfield
- Bayesian analysis of cosmic structures
- Bayesian analysis of spatially distorted cosmic signals from Poissonian data
- Partition function approach to non-Gaussian likelihoods: Formalism and expansions for weakly non-Gaussian cosmological inference
- Halo detection via large-scale Bayesian inference
- Fisher matrix for the angular power spectrum of multi-tracer galaxy surveys
- Differentiable Fuzzy Cosmic-Web for Field Level Inference