Adaptive Independent Sticky MCMC algorithms

Abstract

In this work, we introduce a novel class of adaptive Monte Carlo methods, called adaptive independent sticky MCMC algorithms, for efficient sampling from a generic target probability density function (pdf). The new class of algorithms employs adaptive non-parametric proposal densities which become closer and closer to the target as the number of iterations increases. The proposal pdf is built using interpolation procedures based on a set of support points which is constructed iteratively based on previously drawn samples. The algorithm's efficiency is ensured by a test that controls the evolution of the set of support points. This extra stage controls the computational cost and the convergence of the proposal density to the target. Each part of the novel family of algorithms is discussed and several examples are provided. Although the novel algorithms are presented for univariate target densities, we show that they can be easily extended to the multivariate context within a Gibbs-type sampler. The ergodicity is ensured and discussed. Exhaustive numerical examples illustrate the efficiency of sticky schemes, both as a stand-alone methods to sample from complicated one-dimensional pdfs and within Gibbs in order to draw from multi-dimensional target distributions.

A preliminary Matlab code is provided at https://www.mathworks.com/matlabcentral/fileexchange/54701-adaptive-independent-sticky-metropolis--aism--algorithm

References in corpus (2)

• Improved Adaptive Rejection Metropolis Sampling Algorithms
• Adaptive independent Metropolis--Hastings

Cited by in corpus (9)

• A Survey of Monte Carlo Methods for Parameter Estimation
• Marginal likelihood computation for model selection and hypothesis testing: an extensive review
• The Recycling Gibbs Sampler for Efficient Learning
• Adaptive quadrature schemes for Bayesian inference via active learning
• A survey of Monte Carlo methods for noisy and costly densities with application to reinforcement learning and ABC
• Iterative Construction of Gaussian Process Surrogate Models for Bayesian Inference
• Deep Importance Sampling based on Regression for Model Inversion and Emulation
• Adaptive posterior distributions for uncertainty analysis of covariance matrices in Bayesian inversion problems for multioutput signals
• Adaptive Rejection Sampling with fixed number of nodes