Accelerating ABC methods using Gaussian processes

Abstract

Approximate Bayesian computation (ABC) methods are used to approximate posterior distributions using simulation rather than likelihood calculations. We introduce Gaussian process (GP) accelerated ABC, which we show can significantly reduce the number of simulations required. As computational resource is usually the main determinant of accuracy in ABC, GP-accelerated methods can thus enable more accurate inference in some models. GP models of the unknown log-likelihood function are used to exploit continuity and smoothness, reducing the required computation. We use a sequence of models that increase in accuracy, using intermediate models to rule out regions of the parameter space as implausible. The methods will not be suitable for all problems, but when they can be used, can result in significant computational savings. For the Ricker model, we are able to achieve accurate approximations to the posterior distribution using a factor of 100 fewer simulator evaluations than comparable Monte Carlo approaches, and for a population genetics model we are able to approximate the exact posterior for the first time.

References in corpus (3)

• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Bayesian Indirect Inference Using a Parametric Auxiliary Model
• Sequential Quasi-Monte Carlo

Cited by in corpus (13)

• Flexible statistical inference for mechanistic models of neural dynamics
• Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models
• Variational Bayes with Synthetic Likelihood
• Pre-processing for approximate Bayesian computation in image analysis
• Efficient acquisition rules for model-based approximate Bayesian computation
• A Survey of Bayesian Statistical Approaches for Big Data
• Accelerating Approximate Bayesian Computation with Quantile Regression: Application to Cosmological Redshift Distributions
• Machine Learning Accelerated Likelihood-Free Event Reconstruction in Dark Matter Direct Detection
• A comparison of emulation methods for Approximate Bayesian Computation
• Modeling Extremal Streamflow using Deep Learning Approximations and a Flexible Spatial Process
• Approximate methods for dynamic ecological models
• Transitional annealed adaptive slice sampling for Gaussian process hyper-parameter estimation
• A review of Approximate Bayesian Computation methods via density estimation: inference for simulator-models