Post-Processing of MCMC
arXiv:2103.16048 · doi:10.1146/annurev-statistics-040220-091727
Abstract
Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statistics, being used to approximate the posterior and derived quantities of interest. Despite this, the issue of how the output from a Markov chain is post-processed and reported is often overlooked. Convergence diagnostics can be used to control bias via burn-in removal, but these do not account for (common) situations where a limited computational budget engenders a bias-variance trade-off. The aim of this article is to review state-of-the-art techniques for post-processing Markov chain output. Our review covers methods based on discrepancy minimisation, which directly address the bias-variance trade-off, as well as general-purpose control variate methods for approximating expected quantities of interest.
arXiv commentVersion 3 is the accepted version. When citing this paper, please use the following: South, LF, Riabiz, M, Teymur, O & Oates, CJ. 2022. Post-Processing of MCMC. Annual Review of Statistics and Its Application. 9: Submitted. DOI: 10.1146/annurev-statistics-040220-091727
References in corpus (11)
- MCMC using Hamiltonian dynamics
- Rank-normalization, folding, and localization: An improved for assessing convergence of MCMC
- A General Framework for Updating Belief Distributions
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Zero-variance principle for Monte Carlo algorithms
- Zero-Variance Zero-Bias Principle for Observables in quantum Monte Carlo: Application to Forces
- Zero Variance Markov Chain Monte Carlo for Bayesian Estimators
- Importance Tempering
- Modified Hamiltonian Monte Carlo for Bayesian inference
- Unbiased Markov chain Monte Carlo with couplings
- Computable exponential bounds for screened estimation and simulation
Cited by in corpus (4)
- Bayesian neural networks via MCMC: a Python-based tutorial
- A Kernel Stein Test for Comparing Latent Variable Models
- Multivariate strong invariance principles in Markov chain Monte Carlo
- A Fourier representation of kernel Stein discrepancy with application to Goodness-of-Fit tests for measures on infinite dimensional Hilbert spaces