Non-reversible Metropolis-Hastings

Abstract

The classical Metropolis-Hastings (MH) algorithm can be extended to generate non-reversible Markov chains. This is achieved by means of a modification of the acceptance probability, using the notion of vorticity matrix. The resulting Markov chain is non-reversible. Results from the literature on asymptotic variance, large deviations theory and mixing time are mentioned, and in the case of a large deviations result, adapted, to explain how non-reversible Markov chains have favorable properties in these respects. We provide an application of NRMH in a continuous setting by developing the necessary theory and applying, as first examples, the theory to Gaussian distributions in three and nine dimensions. The empirical autocorrelation and estimated asymptotic variance for NRMH applied to these examples show significant improvement compared to MH with identical stepsize.

in Statistics and Computing, 2015

References in corpus (1)

• Irreversible Langevin samplers and variance reduction: a large deviation approach

Cited by in corpus (19)

• A Survey of Monte Carlo Methods for Parameter Estimation
• The Zig-Zag Process and Super-Efficient Sampling for Bayesian Analysis of Big Data
• Piecewise Deterministic Markov Processes for Continuous-Time Monte Carlo
• Ergodicity of the zigzag process
• A piecewise deterministic scaling limit of Lifted Metropolis-Hastings in the Curie-Weiss model
• Improving the convergence of reversible samplers
• Role of current fluctuations in nonreversible samplers
• Metropolis Sampling
• Thermodynamic bounds on spectral perturbations, with applications to oscillations and relaxation dynamics
• On explicit $L^2$-convergence rate estimate for piecewise deterministic Markov processes in MCMC algorithms
• Metropolis-Hastings reversiblizations of non-reversible Markov chains
• Gibbsian stationary non equilibrium states
• Solution of the Metropolis dynamics on a complete graph with application to the Markov chain Mpemba effect
• An asymptotic Peskun ordering and its application to lifted samplers
• On hitting time, mixing time and geometric interpretations of Metropolis-Hastings reversiblizations
• Jump Restore Light Transport
• Analysis of non-reversible Markov chains via similarity orbit
• Markov chain entropy games and the geometry of their Nash equilibria
• Sampling and statistical physics via symmetry