Anti-concentration and honest, adaptive confidence bands

Abstract

Modern construction of uniform confidence bands for nonparametric densities (and other functions) often relies on the classical Smirnov-Bickel-Rosenblatt (SBR) condition; see, for example, Giné and Nickl [Probab. Theory Related Fields 143 (2009) 569-596]. This condition requires the existence of a limit distribution of an extreme value type for the supremum of a studentized empirical process (equivalently, for the supremum of a Gaussian process with the same covariance function as that of the studentized empirical process). The principal contribution of this paper is to remove the need for this classical condition. We show that a considerably weaker sufficient condition is derived from an anti-concentration property of the supremum of the approximating Gaussian process, and we derive an inequality leading to such a property for separable Gaussian processes. We refer to the new condition as a generalized SBR condition. Our new result shows that the supremum does not concentrate too fast around any value. We then apply this result to derive a Gaussian multiplier bootstrap procedure for constructing honest confidence bands for nonparametric density estimators (this result can be applied in other nonparametric problems as well). An essential advantage of our approach is that it applies generically even in those cases where the limit distribution of the supremum of the studentized empirical process does not exist (or is unknown). This is of particular importance in problems where resolution levels or other tuning parameters have been chosen in a data-driven fashion, which is needed for adaptive constructions of the confidence bands. Finally, of independent interest is our introduction of a new, practical version of Lepski's method, which computes the optimal, nonconservative resolution levels via a Gaussian multiplier bootstrap method.

Published in at http://dx.doi.org/10.1214/14-AOS1235 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (7)

• Gaussian approximation of suprema of empirical processes
• Confidence bands in density estimation
• A simple bootstrap method for constructing nonparametric confidence bands for functions
• Anti-concentration and honest, adaptive confidence bands
• Global uniform risk bounds for wavelet deconvolution estimators
• On adaptive inference and confidence bands
• Testing Regression Monotonicity in Econometric Models

Cited by in corpus (18)

• Gaussian approximation of suprema of empirical processes
• Nonparametric modal regression
• Anti-concentration and honest, adaptive confidence bands
• Simple and Honest Confidence Intervals in Nonparametric Regression
• Change-point detection in high-dimensional covariance structure
• Supremum Norm Posterior Contraction and Credible Sets for Nonparametric Multivariate Regression
• Asymptotic theory for density ridges
• A Simple Adjustment for Bandwidth Snooping
• Inference for First-Price Auctions with Guerre, Perrigne, and Vuong's Estimator
• Unsupervised non-parametric change point detection in quasi-periodic signals
• Monotonicity-Constrained Nonparametric Estimation and Inference for First-Price Auctions
• On frequentist coverage errors of Bayesian credible sets in moderately high dimensions
• Asymptotic confidence sets for the jump curve in bivariate regression problems
• Uniform Confidence Band for Optimal Transport Map on One-Dimensional Data
• Inference on Individual Treatment Effects in Nonseparable Triangular Models
• Some New Asymptotic Theory for Least Squares Series: Pointwise and Uniform Results
• Adaptive monotonicity testing in sublinear time
• Continuous difference-in-differences with double/debiased machine learning