Empirical Bayes selection of wavelet thresholds
arXiv:math/0508281 · doi:10.1214/009053605000000345
Abstract
This paper explores a class of empirical Bayes methods for level-dependent threshold selection in wavelet shrinkage. The prior considered for each wavelet coefficient is a mixture of an atom of probability at zero and a heavy-tailed density. The mixing weight, or sparsity parameter, for each level of the transform is chosen by marginal maximum likelihood. If estimation is carried out using the posterior median, this is a random thresholding procedure; the estimation can also be carried out using other thresholding rules with the same threshold. Details of the calculations needed for implementing the procedure are included. In practice, the estimates are quick to compute and there is software available. Simulations on the standard model functions show excellent performance, and applications to data drawn from various fields of application are used to explore the practical performance of the approach. By using a general result on the risk of the corresponding marginal maximum likelihood approach for a single sequence, overall bounds on the risk of the method are found subject to membership of the unknown function in one of a wide range of Besov classes, covering also the case of f of bounded variation. The rates obtained are optimal for any value of the parameter p in (0,\infty], simultaneously for a wide range of loss functions, each dominating the L_q norm of the \sigmath derivative, with σ\ge0 and 0<q\le2.
Published at http://dx.doi.org/10.1214/009053605000000345 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)
References in corpus (3)
Cited by in corpus (54)
- Covariance regularization by thresholding
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
- An Iterative Wavelet Threshold for Signal Denoising
- Coauthorship and Citation Networks for Statisticians
- Sparse Regression Learning by Aggregation and Langevin Monte-Carlo
- A data-driven block thresholding approach to wavelet estimation
- Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
- A simple forward selection procedure based on false discovery rate control
- Spike-and-Slab Meets LASSO: A Review of the Spike-and-Slab LASSO
- Stochastic expansions using continuous dictionaries: Lévy adaptive regression kernels
- General empirical Bayes wavelet methods and exactly adaptive minimax estimation
- Adaptive variance function estimation in heteroscedastic nonparametric regression
- A majorization-minimization approach to variable selection using spike and slab priors
- Mirror averaging with sparsity priors
- Empirical Bayes Matrix Factorization
- Adaptive estimation of and oracle inequalities for probability densities and characteristic functions
- Minimax and Adaptive Inference in Nonparametric Function Estimation
- Bayesian nonparametric models for peak identification in MALDI-TOF mass spectroscopy
- A Risk Ratio Comparison of and Penalized Regression
- Bayes procedures for adaptive inference in inverse problems for the white noise model
- Adaptive Supremum Norm Posterior Contraction: Wavelet Spike-and-Slab and Anisotropic Besov Spaces
- Data-driven wavelet-Fisz methodology for nonparametric function estimation
- Asymptotic equivalence and adaptive estimation for robust nonparametric regression
- Frequentist optimality of Bayesian wavelet shrinkage rules for Gaussian and non-Gaussian noise
- Solving the Empirical Bayes Normal Means Problem with Correlated Noise
- Adapting to Unknown Smoothness by Aggregation of Thresholded Wavelet Estimators
- Variational approximations of empirical Bayes posteriors in high-dimensional linear models
- Flexible signal denoising via flexible empirical Bayes shrinkage
- Self Consistency: A General Recipe for Wavelet Estimation With Irregularly-spaced and/or Incomplete Data
- Mixed Effect Dirichlet-Tree Multinomial for Longitudinal Microbiome Data and Weight Prediction
- Learning Asymmetric and Local Features in Multi-Dimensional Data through Wavelets with Recursive Partitioning
- Estimating standard errors for importance sampling estimators with multiple Markov chains
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models: Who cares if it is a white cat or a black Cat?
- Empirical Bayes, SURE and Sparse Normal Mean Models
- Bayesian wavelet de-noising with the caravan prior
- Simultaneous Grouping and Denoising via Sparse Convex Wavelet Clustering
- Bayesian nonparametric regression using complex wavelets
- A semiparametric mixture method for local false discovery rate estimation
- Empirical Bayes unfolding of elementary particle spectra at the Large Hadron Collider
- Nonlocal Prior Mixture-Based Bayesian Wavelet Regression with Application to Noisy Imaging and Audio Data
- Spike and Slab Pólya tree posterior distributions: adaptive inference
- Separable nonlinear least-squares parameter estimation for complex dynamic systems
- Signal Denoising Using the Minimum-Probability-of-Error Criterion
- Bayesian Wavelet Shrinkage of the Haar-Fisz Transformed Wavelet Periodogram
- Markov adaptive Pólya trees and multi-resolution adaptive shrinkage in nonparametric modeling
- Cross-Validated Wavelet Block Thresholding for Non-Gaussian Errors
- Smooth blockwise iterative thresholding: a smooth fixed point estimator based on the likelihood's block gradient
- Scalable Bayesian variable selection and model averaging under block orthogonal design
- Semiparametric Wavelet-based JPEG IV Estimator for endogenously truncated data
- ebnm: An R Package for Solving the Empirical Bayes Normal Means Problem Using a Variety of Prior Families
- Fully Bayesian Estimation and Variable Selection in Partially Linear Wavelet Models
- Real-time semiparametric regression
- On posterior distribution of Bayesian wavelet thresholding