Gaussian Approximation of General Nonparametric Posterior Distributions
arXiv:1411.3686
Abstract
In a general class of Bayesian nonparametric models, we prove that the posterior distribution can be asymptotically approximated by a Gaussian process. Our results apply to nonparametric exponential family that contains both Gaussian and non-Gaussian regression, and also hold for both efficient (root-n) and inefficient (non root-n) estimation. Our general approximation theorem does not rely on posterior conjugacy, and can be verified in a class of Gaussian process priors that has a smoothing spline interpretation [59, 44]. In particular, the limiting posterior measure becomes prior-free under a Bayesian version of "under-smoothing" condition. Finally, we apply our approximation theorem to examine the asymptotic frequentist properties of Bayesian procedures such as credible regions and credible intervals.
arXiv commentTo Appear in Information and Inference. In Memory of Prof. Jayanta Ghosh
References in corpus (10)
- Rates of contraction of posterior distributions based on Gaussian process priors
- Adaptive Bayesian estimation using a Gaussian random field with inverse Gamma bandwidth
- Bayesian inverse problems with Gaussian priors
- Reproducing kernel Hilbert spaces of Gaussian priors
- On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- On Bayesian supremum norm contraction rates
- Local and global asymptotic inference in smoothing spline models
- Quantile pyramids for Bayesian nonparametrics
- Bayes procedures for adaptive inference in inverse problems for the white noise model