General empirical Bayes wavelet methods and exactly adaptive minimax estimation
arXiv:math/0504501 · doi:10.1214/009053604000000995
Abstract
In many statistical problems, stochastic signals can be represented as a sequence of noisy wavelet coefficients. In this paper, we develop general empirical Bayes methods for the estimation of true signal. Our estimators approximate certain oracle separable rules and achieve adaptation to ideal risks and exact minimax risks in broad collections of classes of signals. In particular, our estimators are uniformly adaptive to the minimum risk of separable estimators and the exact minimax risks simultaneously in Besov balls of all smoothness and shape indices, and they are uniformly superefficient in convergence rates in all compact sets in Besov spaces with a finite secondary shape parameter. Furthermore, in classes nested between Besov balls of the same smoothness index, our estimators dominate threshold and James-Stein estimators within an infinitesimal fraction of the minimax risks. More general block empirical Bayes estimators are developed. Both white noise with drift and nonparametric regression are considered.
Published at http://dx.doi.org/10.1214/009053604000000995 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
References in corpus (2)
Cited by in corpus (11)
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Empirical Bayes selection of wavelet thresholds
- Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
- General maximum likelihood empirical Bayes estimation of normal means
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- Estimation of the density of regression errors
- Adaptive estimation of and oracle inequalities for probability densities and characteristic functions
- Minimax and Adaptive Inference in Nonparametric Function Estimation
- Robust nonparametric estimation via wavelet median regression
- Asymptotic equivalence and adaptive estimation for robust nonparametric regression
- Variational Multiscale Nonparametric Regression: Algorithms and Implementation