Non-asymptotic confidence intervals for MCMC in practice
arXiv:1212.2016
Abstract
Using concentration inequalities, we give non-asymptotic confidence intervals for estimates obtained by Markov chain Monte Carlo (MCMC) simulations, when using the approximation . To allow the application of non-asymptotic error bounds in practice, here we state bounds formulated in terms of the spectral properties of the chain and the properties of and propose estimators of the parameters appearing in the bounds, including the spectral gap, mixing time, and asymptotic variance. We introduce a method for setting the burn-in time and the initial distribution that is theoretically well-founded and yet is relatively simple to apply. We also investigate the estimation of via subsampling and by using parallel runs instead of a single run. Our results are applicable to both reversible and non-reversible Markov chains on discrete as well as general state spaces. We illustrate our methods by simulations for three examples of Bayesian inference in the context of risk models and clinical trials.
arXiv comment33 pages, 2 figures
References in corpus (5)
- Simulated Tempering: A New Monte Carlo Scheme
- General state space Markov chains and MCMC algorithms
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions
- Explicit error bounds for Markov chain Monte Carlo