Lossless, Scalable Implicit Likelihood Inference for Cosmological Fields

Abstract

We present a comparison of simulation-based inference to full, field-based analytical inference in cosmological data analysis. To do so, we explore parameter inference for two cases where the information content is calculable analytically: Gaussian random fields whose covariance depends on parameters through the power spectrum; and correlated lognormal fields with cosmological power spectra. We compare two inference techniques: i) explicit field-level inference using the known likelihood and ii) implicit likelihood inference with maximally informative summary statistics compressed via Information Maximising Neural Networks (IMNNs). We find that a) summaries obtained from convolutional neural network compression do not lose information and therefore saturate the known field information content, both for the Gaussian covariance and the lognormal cases, b) simulation-based inference using these maximally informative nonlinear summaries recovers nearly losslessly the exact posteriors of field-level inference, bypassing the need to evaluate expensive likelihoods or invert covariance matrices, and c) even for this simple example, implicit, simulation-based likelihood incurs a much smaller computational cost than inference with an explicit likelihood. This work uses a new IMNNs implementation in $\text{Jax}$ that can take advantage of fully-differentiable simulation and inference pipeline. We also demonstrate that a single retraining of the IMNN summaries effectively achieves the theoretically maximal information, enhancing the robustness to the choice of fiducial model where the IMNN is trained.

arXiv commentTo be submitted to JCAP. We provide code and a tutorial for the analysis and relevant software at https://github.com/tlmakinen/FieldIMNNs

References in corpus (31)

• emcee: The MCMC Hammer
• Planck 2015 results. XIII. Cosmological parameters
• The frontier of simulation-based inference
• Karhunen-Loeve eigenvalue problems in cosmology: how should we tackle large data sets?
• Power Spectra for Cold Dark Matter and its Variants
• Fundamental Physics with the Square Kilometre Array
• Bayesian physical reconstruction of initial conditions from large scale structure surveys
• Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
• Fast likelihood-free cosmology with neural density estimators and active learning
• Learning to Predict the Cosmological Structure Formation
• Spectral Classification of Galaxies: An Orthogonal Approach
• Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
• Cosmological constraints with deep learning from KiDS-450 weak lensing maps
• Past and present cosmic structure in the SDSS DR7 main sample
• Automatic physical inference with information maximising neural networks
• Deep learning from 21-cm tomography of the Cosmic Dawn and Reionization
• Generalized massive optimal data compression
• Unmasking the Masked Universe: the 2M++ catalogue through Bayesian eyes
• Cosmological constraints from noisy convergence maps through deep learning
• Planck 2013 results. XXXI. Consistency of the Planck data
• Super-resolution emulator of cosmological simulations using deep physical models
• Massive data compression for parameter-dependent covariance matrices
• deep21: a Deep Learning Method for 21cm Foreground Removal
• GalaxyNet: Connecting galaxies and dark matter haloes with deep neural networks and reinforcement learning in large volumes
• Full-sky Cosmic Microwave Background Foreground Cleaning Using Machine Learning
• Interpreting deep learning models for weak lensing
• On the accuracy and precision of correlation functions and field-level inference in cosmology
• Inpainting Galactic Foreground Intensity and Polarization maps using Convolutional Neural Network
• Fast and Accurate Non-Linear Predictions of Universes with Deep Learning
• Deep-Learning Study of the 21cm Differential Brightness Temperature During the Epoch of Reionization
• Log-transforming the matter power spectrum

Cited by in corpus (11)

• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Learning cosmology and clustering with cosmic graphs
• Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
• $\mathrm{S}\mathrm{IM}\mathrm{BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering
• The Power of Locality: Primordial Non-Gaussianity at the Map Level
• Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks
• Fisher Forecasts for Primordial non-Gaussianity from Persistent Homology
• Cosmological Parameter Estimation and Inference using Deep Summaries
• Quantification of high dimensional non-Gaussianities and its implication to Fisher analysis in cosmology
• A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
• Analytic Correlation of Inflationary Potential to Power Spectrum Shape: Limits of Validity, and `No-Go' for Small Field Model Analytics