Adaptive Hamiltonian and Riemann Manifold Monte Carlo Samplers
arXiv:1302.6182
Abstract
In this paper we address the widely-experienced difficulty in tuning Hamiltonian-based Monte Carlo samplers. We develop an algorithm that allows for the adaptation of Hamiltonian and Riemann manifold Hamiltonian Monte Carlo samplers using Bayesian optimization that allows for infinite adaptation of the parameters of these samplers. We show that the resulting sampling algorithms are ergodic, and that the use of our adaptive algorithms makes it easy to obtain more efficient samplers, in some cases precluding the need for more complex solutions. Hamiltonian-based Monte Carlo samplers are widely known to be an excellent choice of MCMC method, and we aim with this paper to remove a key obstacle towards the more widespread use of these samplers in practice.
arXiv comment10 pages, 4 figures
References in corpus (6)
- Practical Bayesian Optimization of Machine Learning Algorithms
- A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning
- The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
- Portfolio Allocation for Bayesian Optimization
- Grapham: Graphical Models with Adaptive Random Walk Metropolis Algorithms
- Optimal tuning of the Hybrid Monte-Carlo Algorithm
Cited by in corpus (11)
- Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
- Langevin and Hamiltonian based Sequential MCMC for Efficient Bayesian Filtering in High-dimensional Spaces
- Modified Hamiltonian Monte Carlo for Bayesian inference
- Efficient Continuous-Time Markov Chain Estimation
- Hamiltonian Adaptive Importance Sampling
- TensorBNN: Bayesian Inference for Neural Networks using Tensorflow
- Geometrically Tempered Hamiltonian Monte Carlo
- Semi-Separable Hamiltonian Monte Carlo for Inference in Bayesian Hierarchical Models
- Recycling intermediate steps to improve Hamiltonian Monte Carlo
- A Hamiltonian Monte Carlo Model for Imputation and Augmentation of Healthcare Data
- Generalized Elliptical Slice Sampling with Regional Pseudo-priors