Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization

Abstract

We address the inverse problem of cosmic large-scale structure reconstruction from a Bayesian perspective. For a linear data model, a number of known and novel reconstruction schemes, which differ in terms of the underlying signal prior, data likelihood, and numerical inverse extra-regularization schemes are derived and classified. The Bayesian methodology presented in this paper tries to unify and extend the following methods: Wiener-filtering, Tikhonov regularization, Ridge regression, Maximum Entropy, and inverse regularization techniques. The inverse techniques considered here are the asymptotic regularization, the Jacobi, Steepest Descent, Newton-Raphson, Landweber-Fridman, and both linear and non-linear Krylov methods based on Fletcher-Reeves, Polak-Ribiere, and Hestenes-Stiefel Conjugate Gradients. The structures of the up-to-date highest-performing algorithms are presented, based on an operator scheme, which permits one to exploit the power of fast Fourier transforms. Using such an implementation of the generalized Wiener-filter in the novel ARGO-software package, the different numerical schemes are benchmarked with 1-, 2-, and 3-dimensional problems including structured white and Poissonian noise, data windowing and blurring effects. A novel numerical Krylov scheme is shown to be superior in terms of performance and fidelity. These fast inverse methods ultimately will enable the application of sampling techniques to explore complex joint posterior distributions. We outline how the space of the dark-matter density field, the peculiar velocity field, and the power spectrum can jointly be investigated by a Gibbs-sampling process. Such a method can be applied for the redshift distortions correction of the observed galaxies and for time-reversal reconstructions of the initial density field.

40 pages, 11 figures

References in corpus (42)

• Halo Models of Large Scale Structure
• Power Spectra for Cold Dark Matter and its Variants
• Reconstructing the linear power spectrum of cosmological mass fluctuations
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Tests of Gaussianity
• Redshift-Space Distortions, Pairwise Velocities and Nonlinearities
• Measuring the cosmological constant with redshift surveys
• Stochastic Nonlinear Galaxy Biasing
• How to make maps from CMB data without losing information
• Wiener Reconstruction of The Large Scale Structure
• Global, Exact Cosmic Microwave Background Data Analysis Using Gibbs Sampling
• Reconstructed Density and Velocity Fields from the 2MASS Redshift Survey
• Foreground separation methods for satellite observations of the cosmic microwave background
• Eigenmode Analysis of Galaxy Redshift Surveys I. Theory and Methods
• On the Prediction of Velocity Fields from Redshift Space Galaxy Samples
• A Spherical Harmonic Approach to Redshift Distortion and a Measurement of Omega from the 1.2 Jy IRAS Redshift Survey
• Application of Monte Carlo Algorithms to the Bayesian Analysis of the Cosmic Microwave Background
• Wiener Reconstruction of Large-Scale Structure from Peculiar Velocities
• Reconstructing Nonlinear Stochastic Bias from Velocity Space Distortions
• Wiener Reconstruction of Density, Velocity, and Potential Fields from All-Sky Galaxy Redshift Surveys
• A Bayesian approach to discrete object detection in astronomical datasets
• The 2dF Galaxy Redshift Survey: Wiener Reconstruction of the Cosmic Web
• A Map-Making Algorithm for the Planck Surveyor
• Wiener Reconstruction of Galaxy Surveys in Spherical Harmonics
• Observational evidence for stochastic biasing
• MAPCUMBA : a fast iterative multi-grid map-making algorithm for CMB experiments
• A re-analysis of the three-year WMAP temperature power spectrum and likelihood
• Bayesian Power Spectrum Analysis of the First-Year WMAP data
• Making Maps Of The Cosmic Microwave Background: The MAXIMA Example
• Estimation of Polarized Power Spectra by Gibbs sampling
• Madam - a map-making method for CMB experiments
• Cosmological-Constant Cold Dark Matter Models and the COBE Two-Year Sky maps
• Wiener Filtering of the COBE DMR Data
• Wiener Reconstruction of the IRAS 1.2Jy Galaxy Redshift Survey: Cosmographical Implications
• On density and velocity fields and beta from the IRAS PSCz survey
• Non-linear Constrained Realizations of the Large Scale Structure
• Cosmography and Power Spectrum Estimation: a Unified Approach
• Unbiased Reconstruction of the Large Scale Structure
• Optimal Image Reconstruction in Radio Interferometry
• Linearizing the Observed Power Spectrum
• Mirage: a new iterative Map-Making code for CMB experiments
• Markov-chain reconstruction of the 2dF Galaxy Redshift Survey real-space power spectrum
• Finding SZ clusters in the ACBAR maps

Cited by in corpus (104)

• Bayesian physical reconstruction of initial conditions from large scale structure surveys
• Detecting filamentary pattern in the cosmic web: a catalogue of filaments for the SDSS
• Modelling Baryon Acoustic Oscillations with Perturbation Theory and Stochastic Halo Biasing
• Large-scale dark matter simulations
• Information field theory for cosmological perturbation reconstruction and non-linear signal analysis
• ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• Fast Hamiltonian sampling for large scale structure inference
• Simulating polarized Galactic synchrotron emission at all frequencies, the Hammurabi code
• Bayesian power-spectrum inference for Large Scale Structure data
• The Initial Conditions of the Universe from Constrained Simulations
• Are peculiar velocity surveys competitive as a cosmological probe?
• Reconstructing the Cosmic Velocity and Tidal Fields with Galaxy Groups Selected from the Sloan Digital Sky Survey
• Reconstruction of Gaussian and log-normal fields with spectral smoothness
• Bayesian non-linear large scale structure inference of the Sloan Digital Sky Survey data release 7
• Reconstructing the Initial Density Field of the Local Universe: Method and Test with Mock Catalogs
• Hierarchical Cosmic Shear Power Spectrum Inference
• Cosmic Cartography of the Large-Scale Structure with Sloan Digital Sky Survey Data Release 6
• A rigorous EFT-based forward model for large-scale structure
• Constraining the halo bispectrum in real and redshift space from perturbation theory and non-linear stochastic bias
• Recovering the nonlinear density field from the galaxy distribution with a Poisson-Lognormal filter
• New constraints on modelling the random magnetic field of the MW
• Reconstruction of signals with unknown spectra in information field theory with parameter uncertainty
• Reconstruction of the primordial power spectrum of curvature perturbations using multiple data sets
• Simulating Structure Formation of the Local Universe
• Fundamental stellar parameters and metallicities from Bayesian spectroscopy. Application to low- and high-resolution spectra
• Bayesian inference of cosmic density fields from non-linear, scale-dependent, and stochastic biased tracers
• Bayesian analysis of the dynamic cosmic web in the SDSS galaxy survey
• Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
• Methods for Bayesian power spectrum inference with galaxy surveys
• Bayesian inference from photometric redshift surveys
• Multiscale Inference of Matter Fields and Baryon Acoustic Oscillations from the Ly-alpha Forest
• Constrained Simulation of the Bullet Cluster
• Constraining the Cosmic Baryon Distribution with Fast Radio Burst Foreground Mapping
• COSMIC BIRTH: Efficient Bayesian Inference of the Evolving Cosmic Web from Galaxy Surveys
• SIBELIUS-DARK: a galaxy catalogue of the Local Volume from a constrained realisation simulation
• Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
• Estimating cosmic velocity fields from density fields and tidal tensors
• Dark matter voids in the SDSS galaxy survey
• Structural Analysis of the SDSS Cosmic Web I.Nonlinear Density Field Reconstructions
• Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
• FLIMFLAM DR1: The First Constraints on the Cosmic Baryon Distribution from 8 FRB sightlines
• Consistency tests of field level inference with the EFT likelihood
• Matrix-free Large Scale Bayesian inference in cosmology
• Magnetic Deflections of Ultra-High Energy Cosmic Rays from Centaurus A
• BIRTH of the COSMOS Field: Primordial and Evolved Density Reconstructions During Cosmic High Noon
• A fast semi-discrete optimal transport algorithm for a unique reconstruction of the early Universe
• The VIMOS Public Extragalactic Redshift Survey (VIPERS): Reconstruction of the redshift-space galaxy density field
• Probing magnetic helicity with synchrotron radiation and Faraday rotation
• BAO reconstruction: a swift numerical action method for massive spectroscopic surveys
• Exploring the posterior surface of the large scale structure reconstruction
• ELUCID V. Lighting dark matter halos with galaxies
• Galaxy clusters in simulations of the local Universe: a matter of constraints
• Galaxy clusters in local Universe simulations without density constraints: a long uphill struggle
• Efficient Optimal Reconstruction of Linear Fields and Band-powers from Cosmological Data
• Truthing the stretch: Non-perturbative cosmological realizations with multiscale spherical collapse
• Neural physical engines for inferring the halo mass distribution function
• Large-scale density and velocity field reconstructions with neural networks
• The Clustering of Galaxies in the Completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmic Flows and Cosmic Web from Luminous Red Galaxies
• Reconstructing the baryon acoustic oscillations using biased tracers
• Wiener filter reloaded: fast signal reconstruction without preconditioning
• A hierarchical field-level inference approach to reconstruction from sparse Lyman-$\alpha$ forest data
• I- A hydrodynamical CLONE of the Virgo cluster of galaxies to confirm observationally-driven formation scenarios
• Optimal ISW detection and joint likelihood for cosmological parameter estimation
• On the peculiar momentum of baryons after Reionization
• Bayesian cosmic density field inference from redshift space dark matter maps
• Comparing cosmic web classifiers using information theory
• Improving baryon acoustic oscillation measurement with the combination of cosmic voids and galaxies
• How informative are summaries of the cosmic 21-cm signal?
• Mapping Lyman-alpha forest three-dimensional large scale structure in real and redshift space
• hammurabi X: Simulating Galactic Synchrotron Emission with Random Magnetic Fields
• Bayesian astrostatistics: a backward look to the future
• Iterative removal of redshift space distortions from galaxy clustering
• Bayesian angular power spectrum analysis of interferometric data
• Virgo: an unlikely cluster of galaxies because of its environment
• Bayesian redshift-space distortions correction from galaxy redshift surveys
• Field-Based Physical Inference From Peculiar Velocity Tracers
• Merger types forming the Virgo cluster in recent gigayears
• Grid-based calculations of redshift-space matter fluctuations from perturbation theory: UV sensitivity and convergence at the field level
• Luminous giants populate the dense Cosmic Web: The radio luminosity-environmental density relation for radio galaxies in action
• Phenomenology of BAO evolution from Lagrangian to Eulerian Space
• The Information Content of Projected Galaxy Fields
• On the primordial information available to galaxy redshift surveys
• Revisiting the large-scale CMB anomalies: The impact of the SZ signal from the Local Universe
• Higher Order Hamiltonian Monte Carlo Sampling for Cosmological Large-Scale Structure Analysis
• The cosmic spiderweb: equivalence of cosmic, architectural, and origami tessellations
• A Novel Estimator for the Equation of State of the IGM by Ly$\alpha$ Forest Tomography
• Filamentary Baryons and Where to Find Them: A forecast of synchrotron radiation from merger and accretion shocks in the local Cosmic Web
• Cosmic Web & Caustic Skeleton: non-linear Constrained Realizations -- 2D case studies
• Stochastic determination of matrix determinants
• Bayesian Cosmic Web Reconstruction: BARCODE for Clusters
• Efficiently estimating mean, uncertainty and unconstrained large scale fraction of local Universe simulations with paired fixed fields
• Bayesian analysis of cosmic structures
• An Optimized Ly$\alpha$ Forest Inversion Tool Based on a Quantitative Comparison of Existing Reconstruction Methods
• Encoding prior knowledge in the structure of the likelihood
• Leveraging cross-correlations and linear covariance-based filtering for line-intensity map reconstructions at linear scales
• Approximate methods for the generation of dark matter halo catalogs in the age of precision cosmology
• Renormalization group computation of likelihood functions for cosmological data sets
• Partition function approach to non-Gaussian likelihoods: Formalism and expansions for weakly non-Gaussian cosmological inference
• Improved renormalization group computation of likelihood functions for cosmological data sets
• Cosmology behind the mask: Constraining the parameters of $\Lambda$CDM with the unmasked galaxy density field from VIPERS
• Tracing the environmental history of observed galaxies via extended fast action minimization method
• Differentiable Fuzzy Cosmic-Web for Field Level Inference
• ELUCID-DESI I: A Parallel MPI Implementation of the Initial Condition Solver for Large-Scale Reconstruction Simulations