Towards optimal extraction of cosmological information from nonlinear data

Abstract

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.

46 pages, 9 figures; updated figure 9 to the correct version

References in corpus (5)

• Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak
• ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
• Iterative initial condition reconstruction
• Efficient Wiener filtering without preconditioning
• Properties and use of CMB power spectrum likelihoods

Cited by in corpus (86)

• DESI Bright Galaxy Survey: Final Target Selection, Design, and Validation
• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• Modeling Biased Tracers at the Field Level
• Nearest Neighbor distributions: new statistical measures for cosmological clustering
• Scale-dependent galaxy bias, CMB lensing-galaxy cross-correlation, and neutrino masses
• AI-assisted super-resolution cosmological simulations
• The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
• Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection
• A rigorous EFT-based forward model for large-scale structure
• Cosmology From CMB Lensing and Delensed EE Power Spectra Using 2019-2020 SPT-3G Polarization Data
• Cosmology Without Windows: Quadratic Estimators for the Galaxy Power Spectrum
• Bayesian delensing delight: sampling-based inference of the primordial CMB and gravitational lensing
• Reconstructing large-scale structure with neutral hydrogen surveys
• Galaxy bias from forward models: linear and second-order bias of IllustrisTNG galaxies
• Forecasts on Primordial non-Gaussianity from 21 cm Intensity Mapping experiments
• An $n$-th order Lagrangian Forward Model for Large-Scale Structure
• How much information can be extracted from galaxy clustering at the field level?
• GridSPT: Grid-based calculation for perturbation theory of large-scale structure
• Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
• Galaxy power-spectrum responses and redshift-space super-sample effect
• Field Level Neural Network Emulator for Cosmological N-body Simulations
• ENCORE: An $\mathcal{O}(N_{\mathrm{g}}^2)$ Estimator for Galaxy $N$-Point Correlation Functions
• Unbiased Cosmology Inference from Biased Tracers using the EFT Likelihood
• Learning to Simulate High Energy Particle Collisions from Unlabeled Data
• Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
• TARDIS Paper I: A Constrained Reconstruction Approach to Modeling the z~2.5 Cosmic Web Probed by Lyman-alpha Forest Tomography
• Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
• A fast particle-mesh simulation of non-linear cosmological structure formation with massive neutrinos
• The EFT Likelihood for Large-Scale Structure
• Information Content of Higher-Order Galaxy Correlation Functions
• MUSE: Marginal Unbiased Score Expansion and Application to CMB Lensing
• Beware of Fake $\nu$s: The Effect of Massive Neutrinos on the Nonlinear Evolution of Cosmic Structure
• Machine Learning for Observational Cosmology
• A gradient based method for modeling baryons and matter in halos of fast simulations
• Sigma-Eight at the Percent Level: The EFT Likelihood in Real Space
• Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation
• A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
• Baryon acoustic oscillations reconstruction using convolutional neural networks
• Analytic Gaussian Covariance Matrices for Galaxy $N$-Point Correlation Functions
• Exploring the posterior surface of the large scale structure reconstruction
• ELUCID V. Lighting dark matter halos with galaxies
• Nonlinear reconstruction of redshift space distortions
• Efficient Optimal Reconstruction of Linear Fields and Band-powers from Cosmological Data
• The Likelihood for LSS: Stochasticity of Bias Coefficients at All Orders
• Reconstructing the cosmological density and velocity fields from redshifted galaxy distributions using V-net
• Cosmological constraints from the power spectrum and bispectrum of 21cm intensity maps
• Effective cosmic density field reconstruction with convolutional neural network
• Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
• KaRMMa -- Kappa Reconstruction for Mass Mapping
• Probing primordial non-Gaussianity with the power spectrum and bispectrum of future 21cm intensity maps
• Joint velocity and density reconstruction of the Universe with nonlinear differentiable forward modeling
• TARDIS Paper II: Synergistic Density Reconstruction from Lyman-alpha Forest and Spectroscopic Galaxy Surveys with Applications to Protoclusters and the Cosmic Web
• Cosmological Inference from Galaxy-Clustering Power Spectrum: Gaussianization and Covariance Decomposition
• Differentiable Cosmological Simulation with Adjoint Method
• Primordial power spectrum and cosmology from black-box galaxy surveys
• BAO scale inference from biased tracers using the EFT likelihood
• Reconstructing the Universe with Variational self-Boosted Sampling
• Biased tracer reconstruction with halo mass information
• BAO Modulation as a Probe of Compensated Isocurvature Perturbations
• Robust Neural Network-Enhanced Estimation of Local Primordial Non-Gaussianity
• Inference of gravitational lensing and patchy reionization with future CMB data
• Measuring dark matter-neutrino relative velocity on cosmological scales
• Large Scale Structure Reconstruction with Short-Wavelength Modes
• On the primordial information available to galaxy redshift surveys
• Modeling iterative reconstruction and displacement field in the large scale structure
• $\text{PineTree}$: A generative, fast, and differentiable halo model for wide-field galaxy surveys
• Reconstruction with velocities
• Nonlinear Reconstruction of the Velocity Field
• Tests of Acoustic Scale Shifts in Halo-based Mock Galaxy Catalogues
• Improved Lyman Alpha Tomography using Optimized Reconstruction with Constraints on Absorption (ORCA)
• Enhancing CMB map reconstruction and power spectrum estimation with convolutional neural networks
• Massive $\nu$s through the CNN lens: interpreting the field-level neutrino mass information in weak lensing
• Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints
• Testing Quadratic Maximum Likelihood estimators for forthcoming Stage-IV weak lensing surveys
• Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
• Renormalization group computation of likelihood functions for cosmological data sets
• Field-Level Comparison and Robustness Analysis of Cosmological N-body Simulations
• Mind the gap: the power of combining photometric surveys with intensity mapping
• Improved renormalization group computation of likelihood functions for cosmological data sets
• Interpreting Cosmological Information from Neural Networks in the Hydrodynamic Universe
• A Hamiltonian, post-Born, three-dimensional, on-the-fly ray tracing algorithm for gravitational lensing
• JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations
• ELUCID-DESI I: A Parallel MPI Implementation of the Initial Condition Solver for Large-Scale Reconstruction Simulations
• Non-Gaussian likelihood of weak lensing power spectra
• Searching optimal scales for reconstructing cosmological initial conditions using convolutional neural networks
• On the Connection between Field-Level Inference and $n$-point Correlation Functions