Learning Summary Statistic for Approximate Bayesian Computation via Deep Neural Network

Abstract

Approximate Bayesian Computation (ABC) methods are used to approximate posterior distributions in models with unknown or computationally intractable likelihoods. Both the accuracy and computational efficiency of ABC depend on the choice of summary statistic, but outside of special cases where the optimal summary statistics are known, it is unclear which guiding principles can be used to construct effective summary statistics. In this paper we explore the possibility of automating the process of constructing summary statistics by training deep neural networks to predict the parameters from artificially generated data: the resulting summary statistics are approximately posterior means of the parameters. With minimal model-specific tuning, our method constructs summary statistics for the Ising model and the moving-average model, which match or exceed theoretically-motivated summary statistics in terms of the accuracies of the resulting posteriors.

27 pages, 10 figures

Cited by in corpus (6)

• INFERNO: Inference-Aware Neural Optimisation
• Black-box Bayesian inference for economic agent-based models
• Bayesian Calibration of Force-fields from Experimental Data: TIP4P Water
• Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
• Variable Selection with ABC Bayesian Forests
• Deep Learning Aided Laplace Based Bayesian Inference for Epidemiological Systems