Asymptotic equivalence and adaptive estimation for robust nonparametric regression

Abstract

Asymptotic equivalence theory developed in the literature so far are only for bounded loss functions. This limits the potential applications of the theory because many commonly used loss functions in statistical inference are unbounded. In this paper we develop asymptotic equivalence results for robust nonparametric regression with unbounded loss functions. The results imply that all the Gaussian nonparametric regression procedures can be robustified in a unified way. A key step in our equivalence argument is to bin the data and then take the median of each bin. The asymptotic equivalence results have significant practical implications. To illustrate the general principles of the equivalence argument we consider two important nonparametric inference problems: robust estimation of the regression function and the estimation of a quadratic functional. In both cases easily implementable procedures are constructed and are shown to enjoy simultaneously a high degree of robustness and adaptivity. Other problems such as construction of confidence sets and nonparametric hypothesis testing can be handled in a similar fashion.

Published in at http://dx.doi.org/10.1214/08-AOS681 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (12)

• Empirical Bayes selection of wavelet thresholds
• A data-driven block thresholding approach to wavelet estimation
• Nonquadratic estimators of a quadratic functional
• Adaptive confidence balls
• Confidence sets for nonparametric wavelet regression
• Adaptive variance function estimation in heteroscedastic nonparametric regression
• General empirical Bayes wavelet methods and exactly adaptive minimax estimation
• Asymptotic Equivalence for Nonparametric Regression
• Optimal adaptive estimation of a quadratic functional
• Equivalence theory for density estimation, Poisson processes and Gaussian white noise with drift
• Robust nonparametric estimation via wavelet median regression
• Asymptotic equivalence and adaptive estimation for robust nonparametric regression

Cited by in corpus (3)

• A robust, adaptive M-estimator for pointwise estimation in heteroscedastic regression
• Asymptotic equivalence and adaptive estimation for robust nonparametric regression
• A multivariate normal approximation for the Dirichlet density and some applications