Geometrically Tempered Hamiltonian Monte Carlo

Abstract

Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The performance depends critically on the choice of metric, with the Fisher information providing the standard choice. In this article, we propose a new class of metrics aimed at improving HMC's performance on multi-modal target distributions. We refer to the proposed approach as geometrically tempered HMC (GTHMC) due to its connection to other tempering methods. We establish a geometric theory behind RMHMC to motivate GTHMC and characterize its theoretical properties. Moreover, we develop a novel variable step size integrator for simulating Hamiltonian dynamics to improve on the usual Störmer-Verlet integrator which suffers from numerical instability in GTHMC settings. We illustrate GTHMC through simulations, demonstrating generality and substantial gains over standard HMC implementations in terms of effective sample sizes.

44 papges, 3 figures

References in corpus (3)

• Compressible Generalized Hybrid Monte Carlo
• Adaptive Hamiltonian and Riemann Manifold Monte Carlo Samplers
• Variable length trajectory compressible hybrid Monte Carlo

Cited by in corpus (5)

• Modified Hamiltonian Monte Carlo for Bayesian inference
• Multi-stage splitting integrators for sampling with modified Hamiltonian Monte Carlo methods
• Truncated Log-concave Sampling with Reflective Hamiltonian Monte Carlo
• Multimodal Bayesian Registration of Noisy Functions using Hamiltonian Monte Carlo
• Gradients do grow on trees: a linear-time $\mathcal{O}\left(N\right)$-dimensional gradient for statistical phylogenetics