Benchmarking field-level cosmological inference from galaxy redshift surveys

Abstract

Field-level inference has emerged as a promising framework to fully harness the cosmological information encoded in next-generation galaxy surveys. It involves performing Bayesian inference to jointly estimate the cosmological parameters and the initial conditions of the cosmic field, directly from the observed galaxy density field. Yet, the scalability and efficiency of sampling algorithms for field-level inference of large-scale surveys remain unclear. To address this, we introduce a standardized benchmark using a fast and differentiable simulator for the galaxy density field based on $\text{JaxPM}$. We evaluate a range of sampling methods, including standard Hamiltonian Monte Carlo (HMC), No-U-Turn Sampler (NUTS) without and within a Gibbs scheme, and both adjusted and unadjusted microcanonical samplers (MAMS and MCLMC). These methods are compared based on their efficiency, in particular the number of model evaluations required per effective posterior sample. Our findings emphasize the importance of carefully preconditioning latent variables and demonstrate the significant advantage of (unadjusted) MCLMC for scaling to $\ge 10^6$-dimensional problems. We find that MCLMC outperforms adjusted samplers by over an order-of-magnitude, with a mild scaling with the dimension of our inference problem. This benchmark, along with the associated publicly available code, is intended to serve as a basis for the evaluation of future field-level sampling strategies. The code is readily open-sourced at https://github.com/hsimonfroy/benchmark-field-level

28 pages, 10 figures, 2 tables. Accepted to JCAP

References in corpus (29)

• Euclid. I. Overview of the Euclid mission
• Bayesian physical reconstruction of initial conditions from large scale structure surveys
• A General Framework for the Parametrization of Hierarchical Models
• FastPM: a new scheme for fast simulations of dark matter and halos
• Testing and tuning symplectic integrators for Hybrid Monte Carlo algorithm in lattice QCD
• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• Beyond BAO: improving cosmological constraints from BOSS with measurement of the void-galaxy cross-correlation
• Nearest Neighbor distributions: new statistical measures for cosmological clustering
• Simulations and symmetries
• DESI 2024 V: Full-Shape Galaxy Clustering from Galaxies and Quasars
• Numerical integrators for the Hybrid Monte Carlo method
• JAX-COSMO: An End-to-End Differentiable and GPU Accelerated Cosmology Library
• How much information can be extracted from galaxy clustering at the field level?
• FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
• Constraints on the growth of structure around cosmic voids in eBOSS DR14
• Consistency tests of field level inference with the EFT likelihood
• Precise Cosmological Constraints from BOSS Galaxy Clustering with a Simulation-Based Emulator of the Wavelet Scattering Transform
• Impacts of the physical data model on the forward inference of initial conditions from biased tracers
• Encircling the dark: constraining dark energy via cosmic density in spheres
• A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
• New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies
• A note on the exact simulation of spherical Brownian motion
• Joint velocity and density reconstruction of the Universe with nonlinear differentiable forward modeling
• A hierarchical field-level inference approach to reconstruction from sparse Lyman-$\alpha$ forest data
• Probing massive neutrinos with the Minkowski functionals of the galaxy distribution
• Simulation-Based Inference Benchmark for Weak Lensing Cosmology
• BullFrog: Multi-step perturbation theory as a time integrator for cosmological simulations
• Differentiable Cosmological Hydrodynamics for Field-Level Inference and High Dimensional Parameter Constraints
• A theoretical approach to density-split clustering