Adaptation to lowest density regions with application to support recovery

Abstract

A scheme for locally adaptive bandwidth selection is proposed which sensitively shrinks the bandwidth of a kernel estimator at lowest density regions such as the support boundary which are unknown to the statistician. In case of a Hölder continuous density, this locally minimax-optimal bandwidth is shown to be smaller than the usual rate, even in case of homogeneous smoothness. Some new type of risk bound with respect to a density-dependent standardized loss of this estimator is established. This bound is fully nonasymptotic and allows to deduce convergence rates at lowest density regions that can be substantially faster than $n^{-1/2}$. It is complemented by a weighted minimax lower bound which splits into two regimes depending on the value of the density. The new estimator adapts into the second regime, and it is shown that simultaneous adaptation into the fastest regime is not possible in principle as long as the Hölder exponent is unknown. Consequences on plug-in rules for support recovery are worked out in detail. In contrast to those with classical density estimators, the plug-in rules based on the new construction are minimax-optimal, up to some logarithmic factor.

Published at http://dx.doi.org/10.1214/15-AOS1366 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (8)

• Confidence bands in density estimation
• Asymptotics and optimal bandwidth selection for highest density region estimation
• Adaptive estimation of and oracle inequalities for probability densities and characteristic functions
• On Poincaré cone property
• Adaptive goodness-of-fit tests based on signed ranks
• Adaptive pointwise estimation of conditional density function
• Multivariate Density Estimation via Adaptive Partitioning (I): Sieve MLE
• Adaptive estimation of convex and polytopal support

Cited by in corpus (6)

• Minimax theory for a class of non-linear statistical inverse problems
• Minimax Optimal Nonparametric Estimation of Heterogeneous Treatment Effects
• A regularity class for the roots of non-negative functions
• Local bandwidth selection for kernel density estimation in bifurcating Markov chain model
• Asymptotic nonequivalence of density estimation and Gaussian white noise for small densities
• The empirical Christoffel function with applications in data analysis