Lagrangian Dynamical Monte Carlo

Abstract

Hamiltonian Monte Carlo (HMC) improves the computational efficiency of the Metropolis algorithm by reducing its random walk behavior. Riemannian Manifold HMC (RMHMC) further improves HMC's performance by exploiting the geometric properties of the parameter space. However, the geometric integrator used for RMHMC involves implicit equations that require costly numerical analysis (e.g., fixed-point iteration). In some cases, the computational overhead for solving implicit equations undermines RMHMC's benefits. To avoid this problem, we propose an explicit geometric integrator that replaces the momentum variable in RMHMC by velocity. We show that the resulting transformation is equivalent to transforming Riemannian Hamilton dynamics to Lagrangian dynamics. Experimental results show that our method improves RMHMC's overall computational efficiency. All computer programs and data sets are available online (http://www.ics.uci.edu/~babaks/Site/Codes.html) in order to allow replications of the results reported in this paper.

References in corpus (1)

• MCMC using Hamiltonian dynamics

Cited by in corpus (13)

• Geometric MCMC for Infinite-Dimensional Inverse Problems
• Emulation of Higher-Order Tensors in Manifold Monte Carlo Methods for Bayesian Inverse Problems
• Spherical Hamiltonian Monte Carlo for Constrained Target Distributions
• Modified Hamiltonian Monte Carlo for Bayesian inference
• Accurate and Efficient Estimation of Small P-values with the Cross-Entropy Method: Applications in Genomic Data Analysis
• Geometrically Tempered Hamiltonian Monte Carlo
• Sampling Constrained Continuous Probability Distributions: A Review
• Flexible Bayesian Dynamic Modeling of Correlation and Covariance Matrices
• On the application of higher order symplectic integrators in Hamiltonian Monte Carlo
• Understanding MCMC Dynamics as Flows on the Wasserstein Space
• Scaling Up Bayesian Uncertainty Quantification for Inverse Problems using Deep Neural Networks
• On Numerical Considerations for Riemannian Manifold Hamiltonian Monte Carlo
• The Ball Pit Algorithm: A Markov Chain Monte Carlo Method Based on Path Integrals