Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth

Abstract

We consider nonparametric Bayesian estimation inference using a rescaled smooth Gaussian field as a prior for a multidimensional function. The rescaling is achieved using a Gamma variable and the procedure can be viewed as choosing an inverse Gamma bandwidth. The procedure is studied from a frequentist perspective in three statistical settings involving replicated observations (density estimation, regression and classification). We prove that the resulting posterior distribution shrinks to the distribution that generates the data at a speed which is minimax-optimal up to a logarithmic factor, whatever the regularity level of the data-generating distribution. Thus the hierachical Bayesian procedure, with a fixed prior, is shown to be fully adaptive.

Published in at http://dx.doi.org/10.1214/08-AOS678 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (5)

• Rates of contraction of posterior distributions based on Gaussian process priors
• Convergence rates of posterior distributions for noniid observations
• Reproducing kernel Hilbert spaces of Gaussian priors
• Posterior consistency of Gaussian process prior for nonparametric binary regression
• Bayesian inference with rescaled Gaussian process priors