Irreversible Samplers from Jump and Continuous Markov Processes
arXiv:1608.05973 · doi:10.1007/s11222-018-9802-x
Abstract
In this paper, we propose irreversible versions of the Metropolis Hastings (MH) and Metropolis adjusted Langevin algorithm (MALA) with a main focus on the latter. For the former, we show how one can simply switch between different proposal and acceptance distributions upon rejection to obtain an irreversible jump sampler (I-Jump). The resulting algorithm has a simple implementation akin to MH, but with the demonstrated benefits of irreversibility. We then show how the previously proposed MALA method can also be extended to exploit irreversible stochastic dynamics as proposal distributions in the I-Jump sampler. Our experiments explore how irreversibility can increase the efficiency of the samplers in different situations.
References in corpus (21)
- The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
- Steady State Thermodynamics of Langevin Systems
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- Structure of Stochastic Dynamics near Fixed Points
- Irreversible Monte Carlo Algorithms for Efficient Sampling
- Optimal non-reversible linear drift for the convergence to equilibrium of a diffusion
- Variance Reduction using Nonreversible Langevin Samplers
- Accelerating diffusions
- Long-Run Accuracy of Variational Integrators in the Stochastic Context
- Langevin diffusions and the Metropolis-adjusted Langevin algorithm
- Irreversible Langevin samplers and variance reduction: a large deviation approach
- Stochastic Dynamical Structure (SDS) of Nonequilibrium Processes in the Absence of Detailed Balance. III: potential function in local stochastic dynamics and in steady state of Boltzmann-Gibbs type distribution function
- A piecewise deterministic scaling limit of Lifted Metropolis-Hastings in the Curie-Weiss model
- Improving the convergence of reversible samplers
- A Decomposition of Irreversible Diffusion Processes Without Detailed Balance
- Statistical Thermodynamics of General Minimal Diffusion Processes: Constuction, Invariant Density, Reversibility and Entropy Production
- Relation of a New Interpretation of Stochastic Differential Equations to Ito Process
- Acceleration of convergence to equilibrium in Markov chains by breaking detailed balance
- Adaptive Thermostats for Noisy Gradient Systems
- On the long-time integration of stochastic gradient systems
- Universal Ideal Behavior and Macroscopic Work Relation of Linear Irreversible Stochastic Thermodynamics