Improved Adaptive Rejection Metropolis Sampling Algorithms

Abstract

Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference. One of the most important issues for any MCMC method is the convergence of the Markov chain, which depends crucially on a suitable choice of the proposal density. Adaptive Rejection Metropolis Sampling (ARMS) is a well-known MH scheme that generates samples from one-dimensional target densities making use of adaptive piecewise proposals constructed using support points taken from rejected samples. In this work we pinpoint a crucial drawback in the adaptive procedure in ARMS: support points might never be added inside regions where the proposal is below the target. When this happens in many regions it leads to a poor performance of ARMS, with the proposal never converging to the target. In order to overcome this limitation we propose two improved adaptive schemes for constructing the proposal. The first one is a direct modification of the ARMS procedure that incorporates support points inside regions where the proposal is below the target, while satisfying the diminishing adaptation property, one of the required conditions to assure the convergence of the Markov chain. The second one is an adaptive independent MH algorithm with the ability to learn from all previous samples except for the current state of the chain, thus also guaranteeing the convergence to the invariant density. These two new schemes improve the adaptive strategy of ARMS, thus simplifying the complexity in the construction of the proposals. Numerical results show that the new techniques provide better performance w.r.t. the standard ARMS.

Matlab code provided in http://a2rms.sourceforge.net/

References in corpus (1)

• Adaptive independent Metropolis--Hastings

Cited by in corpus (19)

• Effective Sample Size for Importance Sampling based on discrepancy measures
• A Survey of Monte Carlo Methods for Parameter Estimation
• Orthogonal parallel MCMC methods for sampling and optimization
• Marginal likelihood computation for model selection and hypothesis testing: an extensive review
• Fully Adaptive Gaussian Mixture Metropolis-Hastings Algorithm
• The Recycling Gibbs Sampler for Efficient Learning
• Metropolis Sampling
• Adaptive Independent Sticky MCMC algorithms
• Adaptive quadrature schemes for Bayesian inference via active learning
• MCMC-driven importance samplers
• An exhaustive variable selection study for linear models of soundscape emotions: rankings and Gibbs analysis
• Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference
• Parallel Metropolis chains with cooperative adaptation
• Deep Importance Sampling based on Regression for Model Inversion and Emulation
• Sampling by Divergence Minimization
• A minimax near-optimal algorithm for adaptive rejection sampling
• Adaptive Rejection Sampling with fixed number of nodes
• Bayesian Inference Gaussian Process Multiproxy Alignment of Continuous Signals (BIGMACS): Applications for Paleoceanography
• Direct Sampling with a Step Function