Constructing Summary Statistics for Approximate Bayesian Computation: Semi-automatic ABC

Abstract

Many modern statistical applications involve inference for complex stochastic models, where it is easy to simulate from the models, but impossible to calculate likelihoods. Approximate Bayesian computation (ABC) is a method of inference for such models. It replaces calculation of the likelihood by a step which involves simulating artificial data for different parameter values, and comparing summary statistics of the simulated data to summary statistics of the observed data. Here we show how to construct appropriate summary statistics for ABC in a semi-automatic manner. We aim for summary statistics which will enable inference about certain parameters of interest to be as accurate as possible. Theoretical results show that optimal summary statistics are the posterior means of the parameters. While these cannot be calculated analytically, we use an extra stage of simulation to estimate how the posterior means vary as a function of the data; and then use these estimates of our summary statistics within ABC. Empirical results show that our approach is a robust method for choosing summary statistics, that can result in substantially more accurate ABC analyses than the ad-hoc choices of summary statistics proposed in the literature. We also demonstrate advantages over two alternative methods of simulation-based inference.

v2: Revised in response to reviewer comments, adding more examples and a method for inference from multiple data sources

References in corpus (3)

• Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems
• Inferring population history with DIYABC: a user-friendly approach to Approximate Bayesian Computation
• On sequential Monte Carlo, partial rejection control and approximate Bayesian computation

Cited by in corpus (15)

• Stochastic epidemics in a homogeneous community
• Statistical inference for epidemic processes in a homogeneous community (Part IV of the book Stochastic Epidemic Models and Inference)
• Stochastic epidemics in a heterogeneous community (Part III of the book Stochastic Epidemic Models and Inference)
• Inference for SDE models via Approximate Bayesian Computation
• Statistical Inference for Generative Models with Maximum Mean Discrepancy
• Summary Statistics in Approximate Bayesian Computation
• Cosmological Parameter Estimation and Inference using Deep Summaries
• Efficient learning in ABC algorithms
• Bayesian Logistic Regression for Small Areas with Numerous Households
• Probably approximate Bayesian computation: nonasymptotic convergence of ABC under misspecification
• A Simulation Based Inference Approach to the Dynamics of the MW-LMC System -- Validation
• Semi-automatic selection of summary statistics for ABC model choice
• A scalable quasi-Bayesian framework for Gaussian graphical models
• Quantifying the Milky Way, LMC and their interaction using all-sky kinematics of outer halo stars
• Variational Auto-Encoder Based Approximate Bayesian Computation Uncertian Inverse Method for Sheet Metal Forming Problem