Stochastic dynamics without detailed balance condition connecting simple gradient method and Hamiltonian Monte Carlo
arXiv:2107.08633
Abstract
Sampling occupies an important position in theories of various scientific fields, and Markov chain Monte Carlo (MCMC) provides the most common technique of sampling. In the progress of MCMC, a huge number of studies have aimed the acceleration of convergence to the target distribution. Hamiltonian Monte Carlo (HMC) is such a variant of MCMC. In the recent development of MCMC, another approach based on the violation of the detailed balance condition has attracted much attention. Historically, these two approaches have been proposed independently, and their relationship has not been clearly understood. In this paper, the two approaches are seamlessly understood in the framework of generalized Monte Carlo method that violates the detailed balance condition. Furthermore we propose an efficient Monte Carlo method based on our framework.
arXiv comment2 figures
References in corpus (8)
- Simulated Tempering: A New Monte Carlo Scheme
- Multicanonical Ensemble: A New Approach to Simulate First-order Phase Transitions
- Extended Ensemble Monte Carlo
- Markov Chain Monte Carlo Method without Detailed Balance
- Irreversible Monte Carlo Algorithms for Efficient Sampling
- Replica-exchange molecular dynamics simulation for supercooled liquids
- Violation of detailed balance accelerates relaxation
- Role of current fluctuations in nonreversible samplers