Light and Widely Applicable MCMC: Approximate Bayesian Inference for Large Datasets
arXiv:1503.04178
Abstract
Light and Widely Applicable (LWA-) MCMC is a novel approximation of the Metropolis-Hastings kernel targeting a posterior distribution defined on a large number of observations. Inspired by Approximate Bayesian Computation, we design a Markov chain whose transition makes use of an unknown but fixed, fraction of the available data, where the random choice of sub-sample is guided by the fidelity of this sub-sample to the observed data, as measured by summary (or sufficient) statistics. LWA-MCMC is a generic and flexible approach, as illustrated by the diverse set of examples which we explore. In each case LWA-MCMC yields excellent performance and in some cases a dramatic improvement compared to existing methodologies.
26 pages
References in corpus (5)
- The pseudo-marginal approach for efficient Monte Carlo computations
- MCMC for doubly-intractable distributions
- Unbiased Bayes for Big Data: Paths of Partial Posteriors
- Accelerating Metropolis-Hastings algorithms: Delayed acceptance with prefetching
- Calibration of conditional composite likelihood for Bayesian inference on Gibbs random fields