On Contrastive Learning for Likelihood-free Inference
arXiv:2002.03712
Abstract
Likelihood-free methods perform parameter inference in stochastic simulator models where evaluating the likelihood is intractable but sampling synthetic data is possible. One class of methods for this likelihood-free problem uses a classifier to distinguish between pairs of parameter-observation samples generated using the simulator and pairs sampled from some reference distribution, which implicitly learns a density ratio proportional to the likelihood. Another popular class of methods fits a conditional distribution to the parameter posterior directly, and a particular recent variant allows for the use of flexible neural density estimators for this task. In this work, we show that both of these approaches can be unified under a general contrastive learning scheme, and clarify how they should be run and compared.
arXiv commentAppeared at ICML 2020
Cited by in corpus (8)
- Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models
- Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
- Benchmarking Simulation-Based Inference
- Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
- Neural Empirical Bayes: Source Distribution Estimation and its Applications to Simulation-Based Inference
- Sequential Neural Posterior and Likelihood Approximation
- HNPE: Leveraging Global Parameters for Neural Posterior Estimation
- On Contrastive Representations of Stochastic Processes