Riemannian Manifold Hamiltonian Monte Carlo

Abstract

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The method provides a fully automated adaptation mechanism that circumvents the costly pilot runs required to tune proposal densities for Metropolis-Hastings or indeed Hybrid Monte Carlo and Metropolis Adjusted Langevin Algorithms. This allows for highly efficient sampling even in very high dimensions where different scalings may be required for the transient and stationary phases of the Markov chain. The proposed method exploits the Riemannian structure of the parameter space of statistical models and thus automatically adapts to the local manifold structure at each step based on the metric tensor. A semi-explicit second order symplectic integrator for non-separable Hamiltonians is derived for simulating paths across this manifold which provides highly efficient convergence and exploration of the target density. The performance of the Riemannian Manifold Hamiltonian Monte Carlo method is assessed by performing posterior inference on logistic regression models, log-Gaussian Cox point processes, stochastic volatility models, and Bayesian estimation of parameter posteriors of dynamical systems described by nonlinear differential equations. Substantial improvements in the time normalised Effective Sample Size are reported when compared to alternative sampling approaches. Matlab code at \url{http://www.dcs.gla.ac.uk/inference/rmhmc} allows replication of all results.

This paper has been withdrawn by the posting author because he is no longer a co-author of this work

References in corpus (1)

• Efficient Cosmological Parameter Estimation with Hamiltonian Monte Carlo

Cited by in corpus (14)

• MCMC using Hamiltonian dynamics
• Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencoder
• Normalizing Flows on Riemannian Manifolds
• Generalizing Hamiltonian Monte Carlo with Neural Networks
• Goodness of fit in nonlinear dynamics: Misspecified rates or misspecified states?
• Optimal tuning of the Hybrid Monte-Carlo Algorithm
• Hamiltonian Monte Carlo using an adjoint-differentiated Laplace approximation: Bayesian inference for latent Gaussian models and beyond
• Slice Sampling with Adaptive Multivariate Steps: The Shrinking-Rank Method
• Geometry-Aware Hamiltonian Variational Auto-Encoder
• On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo
• An Efficient Implementation of Riemannian Manifold Hamiltonian Monte Carlo for Gaussian Process Models
• Interpretable Stein Goodness-of-fit Tests on Riemannian Manifolds
• Markov chain Monte Carlo for exact inference for diffusions
• Control Theory and Experimental Design in Diffusion Processes