Likelihood-free inference via classification

Abstract

Increasingly complex generative models are being used across disciplines as they allow for realistic characterization of data, but a common difficulty with them is the prohibitively large computational cost to evaluate the likelihood function and thus to perform likelihood-based statistical inference. A likelihood-free inference framework has emerged where the parameters are identified by finding values that yield simulated data resembling the observed data. While widely applicable, a major difficulty in this framework is how to measure the discrepancy between the simulated and observed data. Transforming the original problem into a problem of classifying the data into simulated versus observed, we find that classification accuracy can be used to assess the discrepancy. The complete arsenal of classification methods becomes thereby available for inference of intractable generative models. We validate our approach using theory and simulations for both point estimation and Bayesian inference, and demonstrate its use on real data by inferring an individual-based epidemiological model for bacterial infections in child care centers.

Accepted for publication in Statistics and Computing (Feb 13, 2017)

Cited by in corpus (15)

• VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning
• Variational Approaches for Auto-Encoding Generative Adversarial Networks
• Learning in Implicit Generative Models
• Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA
• Hierarchical Implicit Models and Likelihood-Free Variational Inference
• Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models
• Implicit Maximum Likelihood Estimation
• A Tutorial on Deep Latent Variable Models of Natural Language
• Summary Statistics in Approximate Bayesian Computation
• On the Implicit Assumptions of GANs
• Diverse Image Synthesis from Semantic Layouts via Conditional IMLE
• Variational Generative Stochastic Networks with Collaborative Shaping
• Super-Resolution via Conditional Implicit Maximum Likelihood Estimation
• Robust Optimisation Monte Carlo
• Easy High-Dimensional Likelihood-Free Inference