Likelihood-free inference with emulator networks

Abstract

Approximate Bayesian Computation (ABC) provides methods for Bayesian inference in simulation-based stochastic models which do not permit tractable likelihoods. We present a new ABC method which uses probabilistic neural emulator networks to learn synthetic likelihoods on simulated data -- both local emulators which approximate the likelihood for specific observed data, as well as global ones which are applicable to a range of data. Simulations are chosen adaptively using an acquisition function which takes into account uncertainty about either the posterior distribution of interest, or the parameters of the emulator. Our approach does not rely on user-defined rejection thresholds or distance functions. We illustrate inference with emulator networks on synthetic examples and on a biophysical neuron model, and show that emulators allow accurate and efficient inference even on high-dimensional problems which are challenging for conventional ABC approaches.

arXiv commentIn Advances in Approximate Bayesian Inference (AABI 2018)

References in corpus (1)

• Adam: A Method for Stochastic Optimization

Cited by in corpus (24)

• The frontier of simulation-based inference
• Fast likelihood-free cosmology with neural density estimators and active learning
• Mining gold from implicit models to improve likelihood-free inference
• Nuisance hardened data compression for fast likelihood-free inference
• Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
• Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
• Inference of the optical depth to reionization from low multipole temperature and polarisation Planck data
• Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
• Cosmic Shear: Inference from Forward Models
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Flows for simultaneous manifold learning and density estimation
• Likelihood-free MCMC with Amortized Approximate Ratio Estimators
• Black-Box Optimization with Local Generative Surrogates
• Unbiased likelihood-free inference of the Hubble constant from light standard sirens
• Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
• Cosmological Parameter Estimation and Inference using Deep Summaries
• Ensemble Kalman Inversion for General Likelihoods
• Likelihood-free Forward Modeling for Cluster Weak Lensing and Cosmology
• Neural Density Estimation and Likelihood-free Inference
• Sequential Neural Methods for Likelihood-free Inference
• Confidence Sets and Hypothesis Testing in a Likelihood-Free Inference Setting
• A review of Approximate Bayesian Computation methods via density estimation: inference for simulator-models
• Coping With Simulators That Don't Always Return
• Electoral David vs Goliath: How does the Spatial Concentration of Electors affect District-based Elections?