Towards optimal extraction of cosmological information from nonlinear data
arXiv:1706.06645 · doi:10.1088/1475-7516/2017/12/009
Abstract
One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.
arXiv comment46 pages, 9 figures; updated figure 9 to the correct version
References in corpus (17)
- Large-Scale Structure of the Universe and Cosmological Perturbation Theory
- Observational Probes of Cosmic Acceleration
- Power Spectrum Analysis of Three-Dimensional Redshift Surveys
- Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak
- Estimating the Power Spectrum of the Cosmic Microwave Background
- How to measure CMB power spectra without losing information
- Measuring the galaxy power spectrum with future redshift surveys
- ELUCID - Exploring the Local Universe with reConstructed Initial Density field I: Hamiltonian Markov Chain Monte Carlo Method with Particle Mesh Dynamics
- Past and present cosmic structure in the SDSS DR7 main sample
- Iterative initial condition reconstruction
- Estimators for local non-Gaussianities
- Towards Optimal Measurement of Power Spectra I: Minimum Variance Pair Weighting and the Fisher Matrix
- Reconstructing the Initial Density Field of the Local Universe: Method and Test with Mock Catalogs
- Efficient Wiener filtering without preconditioning
- Properties and use of CMB power spectrum likelihoods
- Cosmography and Power Spectrum Estimation: a Unified Approach
- Estimating CDM Particle Trajectories in the Mildly Non-Linear Regime of Structure Formation. Implications for the Density Field in Real and Redshift Space
Cited by in corpus (87)
- DESI Bright Galaxy Survey: Final Target Selection, Design, and Validation
- Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
- Modeling Biased Tracers at the Field Level
- Nearest Neighbor distributions: new statistical measures for cosmological clustering
- Scale-dependent galaxy bias, CMB lensing-galaxy cross-correlation, and neutrino masses
- The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
- AI-assisted super-resolution cosmological simulations
- Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection
- A rigorous EFT-based forward model for large-scale structure
- Cosmology From CMB Lensing and Delensed EE Power Spectra Using 2019-2020 SPT-3G Polarization Data
- Bayesian delensing delight: sampling-based inference of the primordial CMB and gravitational lensing
- Cosmology Without Windows: Quadratic Estimators for the Galaxy Power Spectrum
- Reconstructing large-scale structure with neutral hydrogen surveys
- Galaxy bias from forward models: linear and second-order bias of IllustrisTNG galaxies
- Forecasts on Primordial non-Gaussianity from 21 cm Intensity Mapping experiments
- How much information can be extracted from galaxy clustering at the field level?
- An -th order Lagrangian Forward Model for Large-Scale Structure
- GridSPT: Grid-based calculation for perturbation theory of large-scale structure
- Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
- Galaxy power-spectrum responses and redshift-space super-sample effect
- Field Level Neural Network Emulator for Cosmological N-body Simulations
- ENCORE: An Estimator for Galaxy -Point Correlation Functions
- Unbiased Cosmology Inference from Biased Tracers using the EFT Likelihood
- TARDIS Paper I: A Constrained Reconstruction Approach to Modeling the z~2.5 Cosmic Web Probed by Lyman-alpha Forest Tomography
- Learning to Simulate High Energy Particle Collisions from Unlabeled Data
- Bayesian field-level inference of primordial non-Gaussianity using next-generation galaxy surveys
- Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
- A fast particle-mesh simulation of non-linear cosmological structure formation with massive neutrinos
- The EFT Likelihood for Large-Scale Structure
- Information Content of Higher-Order Galaxy Correlation Functions
- MUSE: Marginal Unbiased Score Expansion and Application to CMB Lensing
- Beware of Fake s: The Effect of Massive Neutrinos on the Nonlinear Evolution of Cosmic Structure
- Machine Learning for Observational Cosmology
- A gradient based method for modeling baryons and matter in halos of fast simulations
- Sigma-Eight at the Percent Level: The EFT Likelihood in Real Space
- Baryon acoustic oscillations reconstruction using convolutional neural networks
- Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation
- A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
- Recovering lost 21 cm radial modes via cosmic tidal reconstruction
- Analytic Gaussian Covariance Matrices for Galaxy -Point Correlation Functions
- ELUCID V. Lighting dark matter halos with galaxies
- Exploring the posterior surface of the large scale structure reconstruction
- Nonlinear reconstruction of redshift space distortions
- Efficient Optimal Reconstruction of Linear Fields and Band-powers from Cosmological Data
- Reconstructing the cosmological density and velocity fields from redshifted galaxy distributions using V-net
- The Likelihood for LSS: Stochasticity of Bias Coefficients at All Orders
- Cosmological constraints from the power spectrum and bispectrum of 21cm intensity maps
- Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
- Effective cosmic density field reconstruction with convolutional neural network
- Joint velocity and density reconstruction of the Universe with nonlinear differentiable forward modeling
- KaRMMa -- Kappa Reconstruction for Mass Mapping
- Probing primordial non-Gaussianity with the power spectrum and bispectrum of future 21cm intensity maps
- TARDIS Paper II: Synergistic Density Reconstruction from Lyman-alpha Forest and Spectroscopic Galaxy Surveys with Applications to Protoclusters and the Cosmic Web
- Cosmological Inference from Galaxy-Clustering Power Spectrum: Gaussianization and Covariance Decomposition
- Primordial power spectrum and cosmology from black-box galaxy surveys
- Differentiable Cosmological Simulation with Adjoint Method
- BAO scale inference from biased tracers using the EFT likelihood
- Reconstructing the Universe with Variational self-Boosted Sampling
- Biased tracer reconstruction with halo mass information
- Robust Neural Network-Enhanced Estimation of Local Primordial Non-Gaussianity
- BAO Modulation as a Probe of Compensated Isocurvature Perturbations
- Inference of gravitational lensing and patchy reionization with future CMB data
- Measuring dark matter-neutrino relative velocity on cosmological scales
- Modeling iterative reconstruction and displacement field in the large scale structure
- Large Scale Structure Reconstruction with Short-Wavelength Modes
- On the primordial information available to galaxy redshift surveys
- : A generative, fast, and differentiable halo model for wide-field galaxy surveys
- Reconstruction with velocities
- Nonlinear Reconstruction of the Velocity Field
- Tests of Acoustic Scale Shifts in Halo-based Mock Galaxy Catalogues
- Improved Lyman Alpha Tomography using Optimized Reconstruction with Constraints on Absorption (ORCA)
- Massive s through the CNN lens: interpreting the field-level neutrino mass information in weak lensing
- Testing Quadratic Maximum Likelihood estimators for forthcoming Stage-IV weak lensing surveys
- Enhancing CMB map reconstruction and power spectrum estimation with convolutional neural networks
- Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints
- Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
- Field-Level Comparison and Robustness Analysis of Cosmological N-body Simulations
- Renormalization group computation of likelihood functions for cosmological data sets
- Mind the gap: the power of combining photometric surveys with intensity mapping
- Improved renormalization group computation of likelihood functions for cosmological data sets
- Interpreting Cosmological Information from Neural Networks in the Hydrodynamic Universe
- A Hamiltonian, post-Born, three-dimensional, on-the-fly ray tracing algorithm for gravitational lensing
- JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations
- Non-Gaussian likelihood of weak lensing power spectra
- On the Connection between Field-Level Inference and -point Correlation Functions
- ELUCID-DESI I: A Parallel MPI Implementation of the Initial Condition Solver for Large-Scale Reconstruction Simulations
- Searching optimal scales for reconstructing cosmological initial conditions using convolutional neural networks