Bayesian physical reconstruction of initial conditions from large scale structure surveys

Abstract

We present a fully probabilistic, physical model of the non-linearly evolved density field, as probed by realistic galaxy surveys. Our model is valid in the linear and mildly non-linear regimes and uses second order Lagrangian perturbation theory to connect the initial conditions with the final density field. Our parameter space consists of the 3D initial density field and our method allows a fully Bayesian exploration of the sets of initial conditions that are consistent with the galaxy distribution sampling the final density field. A natural byproduct of this technique is an optimal non-linear reconstruction of the present density and velocity fields, including a full propagation of the observational uncertainties. A test of these methods on simulated data mimicking the survey mask, selection function and galaxy number of the SDSS DR7 main sample shows that this physical model gives accurate reconstructions of the underlying present-day density and velocity fields on scales larger than ~6 Mpc/h. Our method naturally and accurately reconstructs non-linear features corresponding to three-point and higher order correlation functions such as walls and filaments. Simple tests of the reconstructed initial conditions show statistical consistency with the Gaussian simulation inputs. Our test demonstrates that statistical approaches based on physical models of the large scale structure distribution are now becoming feasible for realistic current and future surveys.

20 pages, 8 figures

References in corpus (9)

• Methods for Rapidly Processing Angular Masks of Next-Generation Galaxy Surveys
• Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization
• Fast optimal CMB power spectrum estimation with Hamiltonian sampling
• Higher Order Contributions to the 21 cm Power Spectrum
• Estimating cosmic velocity fields from density fields and tidal tensors
• Transients from initial conditions based on Lagrangian perturbation theory in N-body simulations
• The Monge-Ampère-Kantorovich approach to reconstruction in cosmology
• Fast calculation of the Fisher matrix for cosmic microwave background experiments
• Lagrangian reconstruction of cosmic velocity fields

Cited by in corpus (234)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Learning to Predict the Cosmological Structure Formation
• FastPM: a new scheme for fast simulations of dark matter and halos
• ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• ELUCID - Exploring the Local Universe with reConstructed Initial Density field III: Constrained Simulation in the SDSS Volume
• Modeling Biased Tracers at the Field Level
• Halo assembly bias and the tidal anisotropy of the local halo environment
• Past and present cosmic structure in the SDSS DR7 main sample
• Cosmic flows in the nearby Universe: new peculiar velocities from SNe and cosmological constraints
• GLADE+: An Extended Galaxy Catalogue for Multimessenger Searches with Advanced Gravitational-wave Detectors
• Velocity correction for Hubble constant measurements from standard sirens
• Iterative initial condition reconstruction
• Reconstruction of Gaussian and log-normal fields with spectral smoothness
• The Novel Probes Project -- Tests of Gravity on Astrophysical Scales
• Reconstructing the Initial Density Field of the Local Universe: Method and Test with Mock Catalogs
• Unmasking the Masked Universe: the 2M++ catalogue through Bayesian eyes
• Simulations of ultra-high Energy Cosmic Rays in the local Universe and the origin of Cosmic Magnetic Fields
• Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection
• The Gamma-Ray Window to Intergalactic Magnetism
• IMAGINE: A comprehensive view of the interstellar medium, Galactic magnetic fields and cosmic rays
• A rigorous EFT-based forward model for large-scale structure
• Simulation-Based Inference of Reionization Parameters From 3D Tomographic 21 cm Lightcone Images
• Super-resolution emulator of cosmological simulations using deep physical models
• Low Frequency Radio Constraints on the Synchrotron Cosmic Web
• Galaxy morphology rules out astrophysically relevant Hu-Sawicki $f(R)$ gravity
• Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model
• Simulating Structure Formation of the Local Universe
• Bayesian delensing delight: sampling-based inference of the primordial CMB and gravitational lensing
• Genetically modified halos: towards controlled experiments in $\Lambda$CDM galaxy formation
• Bayesian inference of cosmic density fields from non-linear, scale-dependent, and stochastic biased tracers
• Reconstructing large-scale structure with neutral hydrogen surveys
• Bayesian analysis of the dynamic cosmic web in the SDSS galaxy survey
• T-ReX: a graph-based filament detection method
• Galaxy bias from forward models: linear and second-order bias of IllustrisTNG galaxies
• Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
• Propagation of Ultra High Energy Cosmic Rays in Extragalactic Magnetic Fields: A view from cosmological simulations
• Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
• Methods for Bayesian power spectrum inference with galaxy surveys
• An $n$-th order Lagrangian Forward Model for Large-Scale Structure
• Lifting weak lensing degeneracies with a field-based likelihood
• GridSPT: Grid-based calculation for perturbation theory of large-scale structure
• Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
• Bayesian 3d velocity field reconstruction with VIRBIuS
• Mitigating contamination in LSS surveys: a comparison of methods
• FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
• Measuring the giant radio galaxy length distribution with the LoTSS
• COSMIC BIRTH: Efficient Bayesian Inference of the Evolving Cosmic Web from Galaxy Surveys
• Constrained realizations of 2MRS density and peculiar velocity fields: growth rate and local flow
• The cosmic web of the Local Universe: cosmic variance, matter content and its relation to galaxy morphology
• Field Level Neural Network Emulator for Cosmological N-body Simulations
• Unbiased Cosmology Inference from Biased Tracers using the EFT Likelihood
• ENCORE: An $\mathcal{O}(N_{\mathrm{g}}^2)$ Estimator for Galaxy $N$-Point Correlation Functions
• SIBELIUS-DARK: a galaxy catalogue of the Local Volume from a constrained realisation simulation
• Lossless, Scalable Implicit Likelihood Inference for Cosmological Fields
• TARDIS Paper I: A Constrained Reconstruction Approach to Modeling the z~2.5 Cosmic Web Probed by Lyman-alpha Forest Tomography
• Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
• Cosmology Inference from Biased Tracers using the EFT-based Likelihood
• Dark matter voids in the SDSS galaxy survey
• The Cosmic Graph: Optimal Information Extraction from Large-Scale Structure using Catalogues
• Painting halos from cosmic density fields of dark matter with physically motivated neural networks
• Bayesian forward modelling of cosmic shear data
• The EFT Likelihood for Large-Scale Structure
• Observational detection of correlation between galaxy spins and initial conditions
• New method for initial density reconstruction
• Bayesian inference of CMB gravitational lensing
• Information Content of Higher-Order Galaxy Correlation Functions
• Peculiar velocities in the local Universe: comparison of different models and the implications for $H_0$ and dark matter
• Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
• Isobaric Reconstruction of the Baryonic Acoustic Oscillation
• Consistency tests of field level inference with the EFT likelihood
• A Zeldovich reconstruction method for measuring redshift space distortions using cosmic voids
• CosmoPower-JAX: high-dimensional Bayesian inference with differentiable cosmological emulators
• Inferring high redshift large-scale structure dynamics from the Lyman-alpha forest
• Machine Learning for Observational Cosmology
• The SIBELIUS Project: E Pluribus Unum
• Sigma-Eight at the Percent Level: The EFT Likelihood in Real Space
• Disentangling correlated scatter in cluster mass measurements
• Predicted future fate of COSMOS galaxy protoclusters over 11 Gyr with constrained simulations
• Fifth force constraints from the separation of galaxy mass components
• Impacts of the physical data model on the forward inference of initial conditions from biased tracers
• One-point remapping of Lagrangian perturbation theory in the mildly non-linear regime of cosmic structure formation
• The VIMOS Public Extragalactic Redshift Survey (VIPERS): Reconstruction of the redshift-space galaxy density field
• BIRTH of the COSMOS Field: Primordial and Evolved Density Reconstructions During Cosmic High Noon
• Fifth force constraints from galaxy warps
• A fast semi-discrete optimal transport algorithm for a unique reconstruction of the early Universe
• Baryon acoustic oscillations reconstruction using convolutional neural networks
• Analytic Gaussian Covariance Matrices for Galaxy $N$-Point Correlation Functions
• The phase-space structure of nearby dark matter as constrained by the SDSS
• Bayesian estimation of our local motion from the Planck-2018 CMB temperature map
• BAO reconstruction: a swift numerical action method for massive spectroscopic surveys
• Hierarchical probabilistic inference of cosmic shear
• NECOLA: Towards a Universal Field-level Cosmological Emulator
• Exploring the posterior surface of the large scale structure reconstruction
• ELUCID V. Lighting dark matter halos with galaxies
• Cosmology inference at the field level from biased tracers in redshift-space
• Galaxy clusters in local Universe simulations without density constraints: a long uphill struggle
• Galaxy clusters in simulations of the local Universe: a matter of constraints
• The primordial magnetic field in our cosmic backyard
• Efficient Optimal Reconstruction of Linear Fields and Band-powers from Cosmological Data
• Neural physical engines for inferring the halo mass distribution function
• EFTofLSS meets simulation-based inference: ${\sigma }_8$ from biased tracers
• The Likelihood for LSS: Stochasticity of Bias Coefficients at All Orders
• Effective cosmic density field reconstruction with convolutional neural network
• Taking measurements of the kinematic Sunyaev-Zel'dovich effect forward: including uncertainties from velocity reconstruction with forward modeling
• Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
• Explicit Bayesian treatment of unknown foreground contaminations in galaxy surveys
• KaRMMa -- Kappa Reconstruction for Mass Mapping
• The Clustering of Galaxies in the Completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmic Flows and Cosmic Web from Luminous Red Galaxies
• Reconstructing the baryon acoustic oscillations using biased tracers
• Joint velocity and density reconstruction of the Universe with nonlinear differentiable forward modeling
• A hierarchical field-level inference approach to reconstruction from sparse Lyman-$\alpha$ forest data
• Identification of Basins of Attraction in the Local Universe
• Field-level inference of galaxy intrinsic alignment from the SDSS-III BOSS survey
• I- A hydrodynamical CLONE of the Virgo cluster of galaxies to confirm observationally-driven formation scenarios
• Revealing the Local Cosmic Web from Galaxies by Deep Learning
• How to Build a Catalogue of Linearly-Evolving Cosmic Voids
• Multipolar moments of weak lensing signal around clusters. Weighing filaments in harmonic space
• Cosmological Vlasov-Poisson equations for dark matter: Recent developments and connections to selected plasma problems
• Bayesian cosmic density field inference from redshift space dark matter maps
• Constraints on galileons from the positions of supermassive black holes
• Comparing cosmic web classifiers using information theory
• Toward an Optimal Sampling of Peculiar Velocity Surveys For Wiener Filter Reconstructions
• Primordial power spectrum and cosmology from black-box galaxy surveys
• How informative are summaries of the cosmic 21-cm signal?
• Improving baryon acoustic oscillation measurement with the combination of cosmic voids and galaxies
• Differentiable Cosmological Simulation with Adjoint Method
• Cosmic web-type classification using decision theory
• ELUCID -- Exploring the Local Universe with the reConstructed Initial Density field. II: Reconstruction diagnostics, applied to numerical halo catalogs
• The cosmic web connection to the dark matter halo distribution through gravity
• BAO scale inference from biased tracers using the EFT likelihood
• Constraints on dark matter annihilation and decay from the large-scale structure of the nearby universe
• Towards Accurate Field-Level Inference of Massive Cosmic Structures
• Reconstructing dark matter distribution with peculiar velocities: Bayesian forward modelling with corrections for inhomogeneous Malmquist bias
• Cosmology with Persistent Homology: a Fisher Forecast
• Almanac: Weak Lensing power spectra and map inference on the masked sphere
• Virgo: an unlikely cluster of galaxies because of its environment
• Iterative removal of redshift space distortions from galaxy clustering
• Predicting Structures in the Zone of Avoidance
• Luminous giants populate the dense Cosmic Web: The radio luminosity-environmental density relation for radio galaxies in action
• Biased tracer reconstruction with halo mass information
• Field-Based Physical Inference From Peculiar Velocity Tracers
• ELUCID VII: Using Constrained Hydro Simulations to Explore the Gas Component of the Cosmic Web
• Sensitivity reach of gamma-ray measurements for strong cosmological magnetic fields
• Phenomenology of BAO evolution from Lagrangian to Eulerian Space
• Grid-based calculations of redshift-space matter fluctuations from perturbation theory: UV sensitivity and convergence at the field level
• Probabilistic cosmic web classification using fast-generated training data
• Understanding the Reconstruction of the Biased Tracer
• Merger types forming the Virgo cluster in recent gigayears
• Constrained cosmological simulations of the Local Group using Bayesian hierarchical field-level inference
• The Information Content of Projected Galaxy Fields
• Robust Neural Network-Enhanced Estimation of Local Primordial Non-Gaussianity
• Joint Bayesian analysis of large angular scale CMB temperature anomalies
• Accurate field-level weak lensing inference for precision cosmology
• Catalogues of voids as antihalos in the local Universe
• Imprints of the large-scale structure on AGN formation and evolution
• An intergalactic medium temperature from a giant radio galaxy
• Two per cent measurement of $H_0$ from Cepheids alone
• Large Scale Structure Reconstruction with Short-Wavelength Modes
• Posterior inference unchained with EL_2O
• On the primordial information available to galaxy redshift surveys
• Tomography of the Galactic free electron density with the Square Kilometer Array
• Testing screened modified gravity with SDSS-IV-MaNGA
• Cosmic Cartography: Bayesian reconstruction of the galaxy density informed by large-scale structure
• The large-scale environment of thermonuclear and core-collapse supernovae
• Bayesian inference of stellar parameters based on 1D stellar models coupled with 3D envelopes
• $\text{PineTree}$: A generative, fast, and differentiable halo model for wide-field galaxy surveys
• Setting the Stage: Structures from Gaussian Random Fields
• Testing self-interacting dark matter with galaxy warps
• One-point statistics of the Lagrangian displacement field
• Constraints on Equivalence Principle Violation from Gamma Ray Bursts
• Higher Order Hamiltonian Monte Carlo Sampling for Cosmological Large-Scale Structure Analysis
• MUSCLE-UPS: Improved Approximations of the Matter Field with the Extended Press-Schechter Formalism and Lagrangian Perturbation Theory
• Characterizing the Conditional Galaxy Property Distribution using Gaussian Mixture Models
• Efficient simulation of discrete galaxy populations and associated radiation fields during the first billion years
• Revisiting the large-scale CMB anomalies: The impact of the SZ signal from the Local Universe
• Cosmology with cosmic web environments II. Redshift-space auto and cross power spectra
• The four cosmic tidal web elements from the $\beta$-skeleton
• The effect of local universe constraints on halo abundance and clustering
• Optimal machine-driven acquisition of future cosmological data
• Stochastic determination of matrix determinants
• Reducing nuisance prior sensitivity via non-linear reparameterization, with application to EFT analyses of large-scale structure
• Beyond the Lognormal Approximation: a General Simulation Scheme
• Filamentary Baryons and Where to Find Them: A forecast of synchrotron radiation from merger and accretion shocks in the local Cosmic Web
• Renormalization group and UV completion of cosmological perturbations: Gravitational collapse as a critical phenomenon
• Almanac: MCMC-based signal extraction of power spectra and maps on the sphere
• Bayesian Cosmic Web Reconstruction: BARCODE for Clusters
• CosmicRIM : Reconstructing Early Universe by Combining Differentiable Simulations with Recurrent Inference Machines
• A Pair of Early- and Late-Forming Galaxy Cluster Samples: a Novel Way of Studying Halo Assembly Bias Assisted by a Constrained Simulation
• Probabilistic Cosmological Mass Mapping from Weak Lensing Shear
• Evaluating the variance of individual halo properties in constrained cosmological simulations
• A Differentiable, End-to-End Forward Model for 21 cm Cosmology: Estimating the Foreground, Instrument, and Signal Joint Posterior
• Testing the local supervoid solution to the Hubble tension with direct distance tracers
• Constrained simulations of the local Universe with Modified Gravity
• Bayesian large-scale structure inference and cosmic web analysis
• Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints
• Massive $\nu$s through the CNN lens: interpreting the field-level neutrino mass information in weak lensing
• Efficiently estimating mean, uncertainty and unconstrained large scale fraction of local Universe simulations with paired fixed fields
• The effect of environment on the mass assembly history of the Milky Way and M31
• Detectability of large correlation length inflationary magnetic field with Cherenkov telescopes
• The north-south asymmetry of the ALFALFA HI velocity width function
• Fast and accurate collapse-time predictions for collisionless matter
• Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
• The Velocity Field Olympics: Assessing velocity field reconstructions with direct distance tracers
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• Approximate methods for the generation of dark matter halo catalogs in the age of precision cosmology
• All-sky reconstruction of the primordial scalar potential from WMAP temperature data
• Mind the gap: the power of combining photometric surveys with intensity mapping
• Bayesian large-scale structure inference: initial conditions and the cosmic web
• Field-Level Comparison and Robustness Analysis of Cosmological N-body Simulations
• Calculating the EFT likelihood via saddle-point expansion
• SOMBI: Bayesian identification of parameter relations in unstructured cosmological data
• Interpreting Cosmological Information from Neural Networks in the Hydrodynamic Universe
• The galaxy-environment connection revealed by constrained simulations
• Cosmic Strings-induced CMB anisotropies in light of Weighted Morphology
• Bye-bye, Local-in-matter-density Bias: The Statistics of the Halo Field Are Poorly Determined by the Local Mass Density
• Simultaneous Estimation of Large-Scale Structure and Milky Way Dust Extinction from Galaxy Surveys
• Halo detection via large-scale Bayesian inference
• The mass distribution in and around the Local Group
• Precision calculation of the EFT likelihood with primordial non-Gaussianities
• A Hamiltonian, post-Born, three-dimensional, on-the-fly ray tracing algorithm for gravitational lensing
• Fisher matrix for the angular power spectrum of multi-tracer galaxy surveys
• Benchmarking field-level cosmological inference from galaxy redshift surveys
• The Manticore Project II: Bayesian digital twins of cosmic structure across the SDSS and BOSS volumes
• An Anti-halo Void Catalogue of the Local Super-Volume
• Differentiable Fuzzy Cosmic-Web for Field Level Inference
• Bayesian inference of dark matter voids in galaxy surveys
• ELUCID-DESI I: A Parallel MPI Implementation of the Initial Condition Solver for Large-Scale Reconstruction Simulations
• Bayesian inference of the initial conditions from large-scale structure surveys
• On the Connection between Field-Level Inference and $n$-point Correlation Functions
• Probabilistic cartography of the large-scale structure
• Clustering redshifts with the 21cm-galaxy cross-bispectrum
• Fast Sampling of Cosmological Initial Conditions with Gaussian Neural Posterior Estimation
• Diagnosing Systematic Effects Using the Inferred Initial Power Spectrum