A robust, adaptive M-estimator for pointwise estimation in heteroscedastic regression
arXiv:1207.4447 · doi:10.3150/13-BEJ533
Abstract
We introduce a robust and fully adaptive method for pointwise estimation in heteroscedastic regression. We allow for noise and design distributions that are unknown and fulfill very weak assumptions only. In particular, we do not impose moment conditions on the noise distribution. Moreover, we do not require a positive density for the design distribution. In a first step, we study the consistency of locally polynomial M-estimators that consist of a contrast and a kernel. Afterwards, minimax results are established over unidimensional Hölder spaces for degenerate design. We then choose the contrast and the kernel that minimize an empirical variance term and demonstrate that the corresponding M-estimator is adaptive with respect to the noise and design distributions and adaptive (Huber) minimax for contamination models. In a second step, we additionally choose a data-driven bandwidth via Lepski's method. This leads to an M-estimator that is adaptive with respect to the noise and design distributions and, additionally, adaptive with respect to the smoothness of an isotropic, multivariate, locally polynomial target function. These results are also extended to anisotropic, locally constant target functions. Our data-driven approach provides, in particular, a level of robustness that adapts to the noise, contamination, and outliers.
Published in at http://dx.doi.org/10.3150/13-BEJ533 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)
References in corpus (7)
- Confidence bands in density estimation
- On adaptive inference and confidence bands
- Universal pointwise selection rule in multivariate function estimation
- Convergence rates for pointwise curve estimation with a degenerate design
- Parameter tuning in pointwise adaptation using a propagation approach
- Asymptotic equivalence and adaptive estimation for robust nonparametric regression
- Pointwise adaptive estimation for robust and quantile regression