Fast likelihood-free cosmology with neural density estimators and active learning
arXiv:1903.00007 · doi:10.1093/mnras/stz1960
Abstract
Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations. The key challenge for likelihood-free applications in cosmology, where simulation is typically expensive, is developing methods that can achieve high-fidelity posterior inference with as few simulations as possible. Density-estimation likelihood-free inference (DELFI) methods turn inference into a density estimation task on a set of simulated data-parameter pairs, and give orders of magnitude improvements over traditional Approximate Bayesian Computation approaches to likelihood-free inference. In this paper we use neural density estimators (NDEs) to learn the likelihood function from a set of simulated datasets, with active learning to adaptively acquire simulations in the most relevant regions of parameter space on-the-fly. We demonstrate the approach on a number of cosmological case studies, showing that for typical problems high-fidelity posterior inference can be achieved with just simulations or fewer. In addition to enabling efficient simulation-based inference, for simple problems where the form of the likelihood is known, DELFI offers a fast alternative to MCMC sampling, giving orders of magnitude speed-up in some cases. Finally, we introduce \textsc{pydelfi} -- a flexible public implementation of DELFI with NDEs and active learning -- available at \url{https://github.com/justinalsing/pydelfi}.
arXiv commentSubmitted to MNRAS Feb 2019
References in corpus (60)
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- Improved cosmological constraints from a joint analysis of the SDSS-II and SNLS supernova samples
- Karhunen-Loeve eigenvalue problems in cosmology: how should we tackle large data sets?
- Power Spectrum Tomography with Weak Lensing
- Cosmological parameters from lensing power spectrum and bispectrum tomography
- Effects of Baryons and Dissipation on the Matter Power Spectrum
- Weak Lensing and Cosmology
- Solving Large Scale Structure in Ten Easy Steps with COLA
- Galaxy alignments: An overview
- Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
- Dark Synergy: Gravitational Lensing and the CMB
- Origins of weak lensing systematics, and requirements on future instrumentation (or knowledge of instrumentation)
- The Sherwood simulation suite: overview and data comparisons with the Lyman-alpha forest at redshifts 2 < z < 5
- Constraining the thick disc formation scenario of the Milky Way
- Mining gold from implicit models to improve likelihood-free inference
- Constraining Effective Field Theories with Machine Learning
- Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
- A Guide to Constraining Effective Field Theories with Machine Learning
- Large Fluctuations in the High-Redshift Metagalactic Ionizing Background
- Large fluctuations in the hydrogen-ionizing background and mean free path following the epoch of reionization
- Probing Cosmology with Weak Lensing Peak Counts
- Non-Gaussian information from weak lensing data via deep learning
- Type Ia Supernova Light Curve Inference: Hierarchical Bayesian Analysis in the Near Infrared
- Nuisance hardened data compression for fast likelihood-free inference
- Weak lensing power spectra for precision cosmology: Multiple-deflection, reduced shear and lensing bias corrections
- Baryons, Neutrinos, Feedback and Weak Gravitational Lensing
- Approximate Bayesian Computation for Astronomical Model Analysis: A Case Study in Galaxy Demographics and Morphological Transformation at High Redshift
- Automatic physical inference with information maximising neural networks
- Likelihood-Free Cosmological Inference with Type Ia Supernovae: Approximate Bayesian Computation for a Complete Treatment of Uncertainty
- Deep learning from 21-cm tomography of the Cosmic Dawn and Reionization
- Emulation of reionization simulations for Bayesian inference of astrophysics parameters using neural networks
- The Limits of Cosmic Shear
- CARS: The CFHTLS-Archive-Research Survey III. First detection of cosmic magnification in samples of normal high-z galaxies
- Cosmological constraints from noisy convergence maps through deep learning
- Hierarchical Cosmic Shear Power Spectrum Inference
- Bayesian optimisation for likelihood-free cosmological inference
- Weak Gravitational Lensing Bispectrum
- Likelihood-free inference with emulator networks
- A new model to predict weak-lensing peak counts II. Parameter constraint strategies
- On the complementarity of galaxy clustering with cosmic shear and flux magnification
- Bayesian emulator optimisation for cosmology: application to the Lyman-alpha forest
- How Universal is the Gunn-Peterson Trough at z~6?: A Closer Look at the Quasar SDSS J1148+5251
- Cosmological parameters, shear maps and power spectra from CFHTLenS using Bayesian hierarchical inference
- Inferring the mass of sub-millimetre galaxies by exploiting their gravitational magnification of background galaxies
- A New Method to Measure the Post-Reionization Ionizing Background from the Joint Distribution of Lyman- and Lyman- Forest Transmission
- Shear and Magnification: Cosmic Complementarity
- Approximate Bayesian Computation in Large Scale Structure: constraining the galaxy-halo connection
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- On the dissection of degenerate cosmologies with machine learning
- Weak Lensing with Sizes, Magnitudes and Shapes
- Combining Size and Shape in Weak Lensing
- Angular momentum loss for eccentric compact binary in screened modified gravity
- Accelerating Approximate Bayesian Computation with Quantile Regression: Application to Cosmological Redshift Distributions
- zBEAMS: A unified solution for supernova cosmology with redshift uncertainties
- Extreme data compression for the CMB
- Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning
- Machine Learning Accelerated Likelihood-Free Event Reconstruction in Dark Matter Direct Detection
- Bayesian Learning of Neural Network Architectures
- Optimal proposals for Approximate Bayesian Computation
- The many flavours of photometric redshifts
Cited by in corpus (119)
- The frontier of simulation-based inference
- Likelihood-free inference with neural compression of DES SV weak lensing map statistics
- Nuisance hardened data compression for fast likelihood-free inference
- Baryonic effects for weak lensing. Part I. Power spectrum and covariance matrix
- Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
- Simulation-Based Inference of Reionization Parameters From 3D Tomographic 21 cm Lightcone Images
- deep21: a Deep Learning Method for 21cm Foreground Removal
- Inference of the optical depth to reionization from low multipole temperature and polarisation Planck data
- Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
- Matter trispectrum: theoretical modelling and comparison to N-body simulations
- Importance nested sampling with normalising flows
- Field Level Neural Network Emulator for Cosmological N-body Simulations
- Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
- Lossless, Scalable Implicit Likelihood Inference for Cosmological Fields
- Accurate Analytic Model for the Weak Lensing Convergence One-Point Probability Distribution Function and its Auto-Covariance
- Accelerated Bayesian SED Modeling using Amortized Neural Posterior Estimation
- Dynamical mass inference of galaxy clusters with neural flows
- Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
- LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology
- Kernel-Based Emulator for the 3D Matter Power Spectrum from CLASS
- CosmoGridV1: a simulated CDM theory prediction for map-level cosmological inference
- The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
- Breaking baryon-cosmology degeneracy with the electron density power spectrum
- Galaxy Clustering Analysis with SimBIG and the Wavelet Scattering Transform
- Euclid: The reduced shear approximation and magnification bias for Stage IV cosmic shear experiments
- SBI++: Flexible, Ultra-fast Likelihood-free Inference Customized for Astronomical Applications
- : Mock Challenge for a Forward Modeling Approach to Galaxy Clustering
- Constraining the X-ray heating and reionization using 21-cm power spectra with Marginal Neural Ratio Estimation
- Simulation-based inference of dynamical galaxy cluster masses with 3D convolutional neural networks
- A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
- On the accuracy and precision of correlation functions and field-level inference in cosmology
- Black-box Bayesian inference for economic agent-based models
- Likelihood methods for CMB experiments
- Measurement of the B-band Galaxy Luminosity Function with Approximate Bayesian Computation
- Observational cosmology with Artificial Neural Networks
- Cosmological parameter estimation with Genetic Algorithms
- GLASS: Generator for Large Scale Structure
- HIFlow: Generating Diverse HI Maps and Inferring Cosmology while Marginalizing over Astrophysics using Normalizing Flows
- EFTofLSS meets simulation-based inference: from biased tracers
- Galaxy Formation in the Santa Cruz semi-analytic model compared with IllustrisTNG -- I. Galaxy scaling relations, dispersions, and residuals at z=0
- The PAU Survey: Measurement of Narrow-band galaxy properties with Approximate Bayesian Computation
- Fast and robust Bayesian Inference using Gaussian Processes with GPry
- Extracting cosmological parameters from N-body simulations using machine learning techniques
- Fisher Forecasts for Primordial non-Gaussianity from Persistent Homology
- LINNA: Likelihood Inference Neural Network Accelerator
- Likelihood-free Inference with Mixture Density Network
- Bayesian model comparison for simulation-based inference
- On cosmological bias due to the magnification of shear and position samples in modern weak lensing analyses
- Single frequency CMB B-mode inference with realistic foregrounds from a single training image
- Differentiable Cosmological Simulation with Adjoint Method
- Unbiased likelihood-free inference of the Hubble constant from light standard sirens
- Accurate X-ray Timing in the Presence of Systematic Biases With Simulation-Based Inference
- Extreme data compression while searching for new physics
- Cosmological constraints from weak lensing scattering transform using HSC Y1 data
- PopSED: Population-Level Inference for Galaxy Properties from Broadband Photometry with Neural Density Estimation
- Cosmology with Persistent Homology: a Fisher Forecast
- Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
- Machine Learning and Cosmology
- DIGS: Deep Inference of Galaxy Spectra with Neural Posterior Estimation
- Cosmological Parameter Estimation and Inference using Deep Summaries
- A Framework for Obtaining Accurate Posteriors of Strong Gravitational Lensing Parameters with Flexible Priors and Implicit Likelihoods using Density Estimation
- Variational inference of fractional Brownian motion with linear computational complexity
- Reconstructing Probability Distributions with Gaussian Processes
- Neural Simulation-Based Inference of the Neutron Star Equation of State directly from Telescope Spectra
- Likelihood-free Forward Modeling for Cluster Weak Lensing and Cosmology
- Isolated pulsar population synthesis with simulation-based inference
- GEOMAX: beyond linear compression for 3pt galaxy clustering statistics
- Cosmological Tests of Gravity: A Future Perspective
- Simulation-Based Inference of the sky-averaged 21-cm signal from CD-EoR with REACH
- Painting baryons onto N-body simulations of galaxy clusters with image-to-image deep learning
- Fast likelihood-free inference in the LSS Stage IV era
- Dark energy reconstruction analysis with artificial neural networks: Application on simulated Supernova Ia data from Rubin Observatory
- Inferring subhalo effective density slopes from strong lensing observations with neural likelihood-ratio estimation
- SIDE-real: Supernova Ia Dust Extinction with truncated marginal neural ratio estimation applied to real data
- Forecasting constraints on the mean free path of ionizing photons at from the Lyman- forest flux auto-correlation function
- Normalizing flows for random fields in cosmology
- Interpretable Uncertainty Quantification in AI for HEP
- A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
- Weak Lensing Trispectrum and Kurt-Spectra
- Imprint of massive neutrinos on Persistent Homology of large-scale structure
- Neural Density Estimation and Likelihood-free Inference
- Deep Learning and genetic algorithms for cosmological Bayesian inference speed-up
- Measuring the thermal and ionization state of the low- IGM using likelihood free inference
- Probing the Anisotropy and Non-Gaussianity in the Redshift Space through the Conditional Moments of the First Derivative
- The Galactic population of magnetars : a simulation-based inference study
- A Simulation Based Inference Approach to the Dynamics of the MW-LMC System -- Validation
- Gaussian Processes and Nested Sampling Applied to Kepler's Small Long-period Exoplanet Candidates
- Hybrid summary statistics: neural weak lensing inference beyond the power spectrum
- Confidence Sets and Hypothesis Testing in a Likelihood-Free Inference Setting
- Simulation Based Inference for Efficient Theory Space Sampling: an Application to Supersymmetric Explanations of the Anomalous Muon (g-2)
- A Minkowski Functional Analysis of the Cosmic Microwave Background Weak Lensing Convergence
- Machine-guided Exploration and Calibration of Astrophysical Simulations
- Modern Bayesian Sampling Methods for Cosmological Inference: A Comparative Study
- The RSD Sorting Hat: Unmixing Radial Scales in Projection
- 3-D Relative Localization for Multi-Robot Systems with Angle and Self-Displacement Measurements
- Cosmic Strings-induced CMB anisotropies in light of Weighted Morphology
- STAR NRE: Solving supernova selection effects with set-based truncated auto-regressive neural ratio estimation
- 3D ScatterNet: Inference from 21 cm Light-cones
- Learning to discover: expressive Gaussian mixture models for multi-dimensional simulation and parameter inference in the physical sciences
- Mitigating Model Misspecification in Simulation-Based Inference for Galaxy Clustering
- Flexible Simulation Based Inference for Galaxy Photometric Fitting with Synthesizer
- Quantifying the Milky Way, LMC and their interaction using all-sky kinematics of outer halo stars
- Forward-modelling Milky Way Cepheids: selection effects and physical priors in the Gaia-HST calibration
- Probabilistic Spectral Reconstruction of Trans-Neptunian Objects from Sparse Photometry: A Framework for Taxonomy, Survey Optimization, and Outlier Detection
- A New Estimator for Phase Statistics
- Towards characterizing dark matter subhalo perturbations in stellar streams with graph neural networks
- JERALD: high-fidelity dark matter, stellar mass and neutral hydrogen maps from fast N-body simulations
- A review of Approximate Bayesian Computation methods via density estimation: inference for simulator-models
- Deep inference of simulated strong lenses in ground-based surveys
- Forecast constraints on null tests of the CDM model with SPHEREx
- How to embed any likelihood into SBI: Application to Planck + Stage IV galaxy surveys and Dynamical Dark Energy
- FlowSN: Neural Simulation-Based Inference under Realistic Selection Effects applied to Supernova Cosmology
- Simulation-based inference with the integrated 3PCF
- Constraining cosmological parameters using density split lensing and the conditional stellar mass function
- Skew-spectra: a generalization to spin-
- Quantifying Weighted Morphological Content of Large-Scale Structures via Simulation-Based Inference
- Accelerating reionization constraints: An ANN-emulator framework for the SCRIPT Semi-numerical Model
- Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67
- Non-Gaussian likelihood of weak lensing power spectra