Bayesian Indirect Inference Using a Parametric Auxiliary Model

Abstract

Indirect inference (II) is a methodology for estimating the parameters of an intractable (generative) model on the basis of an alternative parametric (auxiliary) model that is both analytically and computationally easier to deal with. Such an approach has been well explored in the classical literature but has received substantially less attention in the Bayesian paradigm. The purpose of this paper is to compare and contrast a collection of what we call parametric Bayesian indirect inference (pBII) methods. One class of pBII methods uses approximate Bayesian computation (referred to here as ABC II) where the summary statistic is formed on the basis of the auxiliary model, using ideas from II. Another approach proposed in the literature, referred to here as parametric Bayesian indirect likelihood (pBIL), uses the auxiliary likelihood as a replacement to the intractable likelihood. We show that pBIL is a fundamentally different approach to ABC II. We devise new theoretical results for pBIL to give extra insights into its behaviour and also its differences with ABC II. Furthermore, we examine in more detail the assumptions required to use each pBII method. The results, insights and comparisons developed in this paper are illustrated on simple examples and two other substantive applications. The first of the substantive examples involves performing inference for complex quantile distributions based on simulated data while the second is for estimating the parameters of a trivariate stochastic process describing the evolution of macroparasites within a host based on real data. We create a novel framework called Bayesian indirect likelihood (BIL) that encompasses pBII as well as general ABC methods so that the connections between the methods can be established.

Published at http://dx.doi.org/10.1214/14-STS498 in the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (3)

• The pseudo-marginal approach for efficient Monte Carlo computations
• A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
• Bayesian Indirect Inference Using a Parametric Auxiliary Model

Cited by in corpus (28)

• An 800-million-solar-mass black hole in a significantly neutral Universe at redshift 7.5
• Quantitative Constraints on the Reionization History from the IGM Damping Wing Signature in Two Quasars at z > 7
• Bayesian Indirect Inference Using a Parametric Auxiliary Model
• Accelerating ABC methods using Gaussian processes
• Pre-processing for approximate Bayesian computation in image analysis
• Bayesian Inference of Spreading Processes on Networks
• Bayesian model comparison with un-normalised likelihoods
• K2-ABC: Approximate Bayesian Computation with Kernel Embeddings
• Approximate Bayesian Computation with composite score functions
• Summary Statistics in Approximate Bayesian Computation
• Bayesian Restricted Likelihood Methods: Conditioning on Insufficient Statistics in Bayesian Regression
• Constraining the intrinsic population of Long Gamma-Ray Bursts: implications for spectral correlations, cosmic evolution and their use as tracers of star formation
• Inferring the photometric and size evolution of galaxies from image simulations
• Approximating Bayes in the 21st Century
• Approximating the Likelihood in Approximate Bayesian Computation
• Robust approximate Bayesian inference
• Robust Bayesian Synthetic Likelihood via a Semi-Parametric Approach
• Generalized Bayesian Likelihood-Free Inference
• Gaussian process modeling in approximate Bayesian computation to estimate horizontal gene transfer in bacteria
• An easy-to-use empirical likelihood ABC method
• Validation and Inference of Agent Based Models
• Likelihood-free approximate Gibbs sampling
• Recalibration: A post-processing method for approximate Bayesian computation
• On a Variational Approximation based Empirical Likelihood ABC Method
• A Note on Using Discretized Simulated Data to Estimate Implicit Likelihoods in Bayesian Analyses
• Bayesian Semi-supervised Inference via a Debiased Modeling Approach
• Detecting conflicting summary statistics in likelihood-free inference
• A simple recipe for making accurate parametric inference in finite sample