Supremum Norm Posterior Contraction and Credible Sets for Nonparametric Multivariate Regression
arXiv:1411.6716 · doi:10.1214/15-AOS1398
Abstract
In the setting of nonparametric multivariate regression with unknown error variance, we study asymptotic properties of a Bayesian method for estimating a regression function f and its mixed partial derivatives. We use a random series of tensor product of B-splines with normal basis coefficients as a prior for f, and the error variance is either estimated using the empirical Bayes approach or is endowed with a suitable prior in a hierarchical Bayes approach. We establish pointwise, L2 and supremum norm posterior contraction rates for f and its mixed partial derivatives, and show that they coincide with the minimax rates. Our results cover even the anisotropic situation, where the true regression function may have different smoothness in different directions. Using the convergence bounds, we show that pointwise, L2 and supremum norm credible sets for f and its mixed partial derivatives have guaranteed frequentist coverage with optimal size. New results on tensor products of B-splines are also obtained in the course.
arXiv comment36 pages, 2 figures, uses imsart.sty
References in corpus (12)
- Bayesian inverse problems with Gaussian priors
- Frequentist coverage of adaptive nonparametric Bayesian credible sets
- Confidence bands in density estimation
- On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
- Anti-concentration and honest, adaptive confidence bands
- Nonparametric Bernstein-von Mises theorems in Gaussian white noise
- On Bayesian supremum norm contraction rates
- Adaptive Bernstein-von Mises theorems in Gaussian white noise
- Rates of contraction for posterior distributions in $\bolds{L^r}$-metrics, $\bolds{1\le r\le\infty}$
- Bayesian recovery of the initial condition for the heat equation
- On adaptive posterior concentration rates
- Adaptive Bayesian density regression for high-dimensional data
Cited by in corpus (4)
- Bayesian Quantile Regression Using Random B-spline Series Prior
- Comparing and weighting imperfect models using D-probabilities
- On frequentist coverage errors of Bayesian credible sets in moderately high dimensions
- Contributed Discussion to Bayesian Solution Uncertainty Quantification for Differential Equations