Bayesian optimisation for likelihood-free cosmological inference

Abstract

Many cosmological models have only a finite number of parameters of interest, but a very expensive data-generating process and an intractable likelihood function. We address the problem of performing likelihood-free Bayesian inference from such black-box simulation-based models, under the constraint of a very limited simulation budget (typically a few thousand). To do so, we adopt an approach based on the likelihood of an alternative parametric model. Conventional approaches to approximate Bayesian computation such as likelihood-free rejection sampling are impractical for the considered problem, due to the lack of knowledge about how the parameters affect the discrepancy between observed and simulated data. As a response, we make use of a strategy previously developed in the machine learning literature (Bayesian optimisation for likelihood-free inference, BOLFI), which combines Gaussian process regression of the discrepancy to build a surrogate surface with Bayesian optimisation to actively acquire training data. We extend the method by deriving an acquisition function tailored for the purpose of minimising the expected uncertainty in the approximate posterior density, in the parametric approach. The resulting algorithm is applied to the problems of summarising Gaussian signals and inferring cosmological parameters from the Joint Lightcurve Analysis supernovae data. We show that the number of required simulations is reduced by several orders of magnitude, and that the proposed acquisition function produces more accurate posterior approximations, as compared to common strategies.

16+9 pages, 12 figures. Matches PRD published version after minor modifications

References in corpus (15)

• A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
• New Hubble Space Telescope Discoveries of Type Ia Supernovae at z > 1: Narrowing Constraints on the Early Behavior of Dark Energy
• Supernova Constraints and Systematic Uncertainties from the First 3 Years of the Supernova Legacy Survey
• CfA3: 185 Type Ia Supernova Light Curves from the CfA
• SNLS3: Constraints on Dark Energy Combining the Supernova Legacy Survey Three Year Data with Other Probes
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• Automatic physical inference with information maximising neural networks
• Generalized massive optimal data compression
• Massive data compression for parameter-dependent covariance matrices
• astroABC: An Approximate Bayesian Computation Sequential Monte Carlo sampler for cosmological parameter estimation
• Efficient Wiener filtering without preconditioning
• Bayesian analysis of the dynamic cosmic web in the SDSS galaxy survey
• Inferring Cognitive Models from Data using Approximate Bayesian Computation
• Enhancing BOSS bispectrum cosmological constraints with maximal compression
• Likelihood Non-Gaussianity in Large-Scale Structure Analyses

Cited by in corpus (45)

• Fast likelihood-free cosmology with neural density estimators and active learning
• Likelihood-free inference with neural compression of DES SV weak lensing map statistics
• Nuisance hardened data compression for fast likelihood-free inference
• Bayesian emulator optimisation for cosmology: application to the Lyman-alpha forest
• Classifying the Large Scale Structure of the Universe with Deep Neural Networks
• Inference of the optical depth to reionization from low multipole temperature and polarisation Planck data
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Accelerating Large-Scale-Structure data analyses by emulating Boltzmann solvers and Lagrangian Perturbation Theory
• Cosmic Shear: Inference from Forward Models
• Cosmological parameter estimation via iterative emulation of likelihoods
• LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology
• Kernel-Based Emulator for the 3D Matter Power Spectrum from CLASS
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Machine Learning for Observational Cosmology
• Neural network reconstructions for the Hubble parameter, growth rate and distance modulus
• Cosmology with cosmic web environments I. Real-space power spectra
• Simulation-based inference of dynamical galaxy cluster masses with 3D convolutional neural networks
• Likelihood methods for CMB experiments
• On the accuracy and precision of correlation functions and field-level inference in cosmology
• Multi-Fidelity Emulation for the Matter Power Spectrum using Gaussian Processes
• KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear
• Cosmological parameter estimation with Genetic Algorithms
• Parameter Inference for Weak Lensing using Gaussian Processes and MOPED
• GLASS: Generator for Large Scale Structure
• EFTofLSS meets simulation-based inference: ${\sigma }_8$ from biased tracers
• A Bayesian method for combining theoretical and simulated covariance matrices for large-scale structure surveys
• LINNA: Likelihood Inference Neural Network Accelerator
• Primordial power spectrum and cosmology from black-box galaxy surveys
• A simulation-based inference pipeline for cosmic shear with the Kilo-Degree Survey
• A Bayesian Optimization approach for calibrating large-scale activity-based transport models
• Extreme data compression while searching for new physics
• Bayesian Comparison of the Cosmic Duality Scenarios
• Accelerating cosmological inference with Gaussian processes and neural networks -- an application to LSST Y1 weak lensing and galaxy clustering
• Perfectly parallel cosmological simulations using spatial comoving Lagrangian acceleration
• Likelihood-free Forward Modeling for Cluster Weak Lensing and Cosmology
• Parameter inference and model comparison using theoretical predictions from noisy simulations
• MF-Box: Multi-fidelity and multi-scale emulation for the matter power spectrum
• COmoving Computer Acceleration (COCA): $N$-body simulations in an emulated frame of reference
• Confidence Sets and Hypothesis Testing in a Likelihood-Free Inference Setting
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Boosting MonteCarlo sampling with a non-Gaussian fit
• Simulation-based inference of Bayesian hierarchical models while checking for model misspecification
• Towards characterizing dark matter subhalo perturbations in stellar streams with graph neural networks
• On the Connection between Field-Level Inference and $n$-point Correlation Functions
• Diagnosing Systematic Effects Using the Inferred Initial Power Spectrum