A Simulated Annealing Approach to Approximate Bayes Computations

Abstract

Approximate Bayes Computations (ABC) are used for parameter inference when the likelihood function of the model is expensive to evaluate but relatively cheap to sample from. In particle ABC, an ensemble of particles in the product space of model outputs and parameters is propagated in such a way that its output marginal approaches a delta function at the data and its parameter marginal approaches the posterior distribution. Inspired by Simulated Annealing, we present a new class of particle algorithms for ABC, based on a sequence of Metropolis kernels, associated with a decreasing sequence of tolerances w.r.t. the data. Unlike other algorithms, our class of algorithms is not based on importance sampling. Hence, it does not suffer from a loss of effective sample size due to re-sampling. We prove convergence under a condition on the speed at which the tolerance is decreased. Furthermore, we present a scheme that adapts the tolerance and the jump distribution in parameter space according to some mean-fields of the ensemble, which preserves the statistical independence of the particles, in the limit of infinite sample size. This adaptive scheme aims at converging as close as possible to the correct result with as few system updates as possible via minimizing the entropy production in the system. The performance of this new class of algorithms is compared against two other recent algorithms on two toy examples.

20 pages, 2 figures

References in corpus (5)

• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Adaptive approximate Bayesian computation for complex models
• Quantitative bounds on convergence of time-inhomogeneous Markov chains
• On the Stability of Sequential Monte Carlo Methods in High Dimensions
• Efficient learning in ABC algorithms

Cited by in corpus (9)

• Bayesian Inference of Spreading Processes on Networks
• Boosting Bayesian Parameter Inference of Nonlinear Stochastic Differential Equation Models by Hamiltonian Scale Separation
• ABCpy: A High-Performance Computing Perspective to Approximate Bayesian Computation
• A comparison of emulation methods for Approximate Bayesian Computation
• Distance-learning For Approximate Bayesian Computation To Model a Volcanic Eruption
• Likelihood-free parameter estimation for dynamic queueing networks: case study of passenger flow in an international airport terminal
• Soft Constraints for Inference with Declarative Knowledge
• SPUX Framework: a Scalable Package for Bayesian Uncertainty Quantification and Propagation
• A Simulated Annealing Approach to Bayesian Inference