On adaptive inference and confidence bands

Abstract

The problem of existence of adaptive confidence bands for an unknown density $f$ that belongs to a nested scale of Hölder classes over $\mathbb{R}$ or $[0,1]$ is considered. Whereas honest adaptive inference in this problem is impossible already for a pair of Hölder balls $\Sigma (r),\Sigma (s),r\ne s$, of fixed radius, a nonparametric distinguishability condition is introduced under which adaptive confidence bands can be shown to exist. It is further shown that this condition is necessary and sufficient for the existence of honest asymptotic confidence bands, and that it is strictly weaker than similar analytic conditions recently employed in Giné and Nickl [Ann. Statist. 38 (2010) 1122--1170]. The exceptional sets for which honest inference is not possible have vanishingly small probability under natural priors on Hölder balls $\Sigma (s)$. If no upper bound for the radius of the Hölder balls is known, a price for adaptation has to be paid, and near-optimal adaptation is possible for standard procedures. The implications of these findings for a general theory of adaptive inference are discussed.

Published in at http://dx.doi.org/10.1214/11-AOS903 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (11)

• Rates of contraction of posterior distributions based on Gaussian process priors
• Can one estimate the conditional distribution of post-model-selection estimators?
• Confidence bands in density estimation
• Global uniform risk bounds for wavelet deconvolution estimators
• An adaptation theory for nonparametric confidence intervals
• Adaptive nonparametric confidence sets
• Adaptive confidence balls
• Uniform limit theorems for wavelet density estimators
• Confidence balls in Gaussian regression
• Adaptive estimation of a distribution function and its density in sup-norm loss by wavelet and spline projections
• Concentration Inequalities and Confidence Bands for Needlet Density Estimators on Compact Homogeneous Manifolds

Cited by in corpus (22)

• Frequentist coverage of adaptive nonparametric Bayesian credible sets
• A simple bootstrap method for constructing nonparametric confidence bands for functions
• Anti-concentration and honest, adaptive confidence bands
• Confidence sets in sparse regression
• Adaptive Bernstein-von Mises theorems in Gaussian white noise
• On adaptive posterior concentration rates
• Testability of high-dimensional linear models with non-sparse structures
• Uncertainty Quantification for Matrix Compressed Sensing and Quantum Tomography Problems
• A robust, adaptive M-estimator for pointwise estimation in heteroscedastic regression
• Testing the regularity of a smooth signal
• Adaptive confidence bands for Markov chains and diffusions: Estimating the invariant measure and the drift
• Confidence regions and minimax rates in outlier-robust estimation on the probability simplex
• Locally Adaptive Density Estimation on the Unit Sphere Using Needlets
• Discussion of "Frequentist coverage of adaptive nonparametric Bayesian credible sets"
• Adaptive Inference in Multivariate Nonparametric Regression Models Under Monotonicity
• On Semi-parametric Bernstein-von Mises Theorems for BART
• Optimal regularized hypothesis testing in statistical inverse problems
• Smooth Bandit Optimization: Generalization to Hölder Space
• Optimal Adaptive Inference in Random Design Binary Regression
• The smoothness test for a density function
• Spike and Slab Pólya tree posterior distributions: adaptive inference
• Adaptive confidence sets in L^2