Regeneration-enriched Markov processes with application to Monte Carlo

Abstract

We study a class of Markov processes that combine local dynamics, arising from a fixed Markov process, with regenerations arising at a state-dependent rate. We give conditions under which such processes possess a given target distribution as their invariant measures, thus making them amenable for use within Monte Carlo methodologies. Since the regeneration mechanism can compensate the choice of local dynamics, while retaining the same invariant distribution, great flexibility can be achieved in selecting local dynamics, and the mathematical analysis is simplified. We give straightforward conditions for the process to possess a central limit theorem, and additional conditions for uniform ergodicity and for a coupling from the past construction to hold, enabling exact sampling from the invariant distribution. We further consider and analyse a natural approximation of the process which may arise in the practical simulation of some classes of continuous-time dynamics.

arXiv commentv3: 43 pages, 3 figures. Some clarifications added. Accepted version, to appear in Ann. Appl. Probab

References in corpus (7)

• The Zig-Zag Process and Super-Efficient Sampling for Bayesian Analysis of Big Data
• Piecewise-Deterministic Markov Chain Monte Carlo
• Unbiased Markov chain Monte Carlo with couplings
• An approximation scheme for quasi-stationary distributions of killed diffusions
• Theoretical properties of quasi-stationary Monte Carlo methods
• Perfect simulation using atomic regeneration with application to Sequential Monte Carlo
• A note on the jump locations of Markov processes

Cited by in corpus (4)

• Linking the mixing times of random walks on static and dynamic random graphs
• Control of probability flow in Markov chain Monte Carlo -- Nonreversibility and lifting
• Automated design of compound lenses with discrete-continuous optimization
• Perturbation theory for killed Markov processes and quasi-stationary distributions