Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector

Abstract

For the important classical problem of inference on a sparse high-dimensional normal mean vector, we propose a novel empirical Bayes model that admits a posterior distribution with desirable properties under mild conditions. In particular, our empirical Bayes posterior distribution concentrates on balls, centered at the true mean vector, with squared radius proportional to the minimax rate, and its posterior mean is an asymptotically minimax estimator. We also show that, asymptotically, the support of our empirical Bayes posterior has roughly the same effective dimension as the true sparse mean vector. Simulation from our empirical Bayes posterior is straightforward, and our numerical results demonstrate the quality of our method compared to others having similar large-sample properties.

18 pages, 3 figures, 3 tables

References in corpus (14)

• Optimal rates of convergence for covariance matrix estimation
• Microarrays, Empirical Bayes and the Two-Groups Model
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
• General maximum likelihood empirical Bayes estimation of normal means
• From $\epsilon$-entropy to KL-entropy: Analysis of minimum information complexity density estimation
• Optimal rates of convergence for sparse covariance matrix estimation
• Gibbs posterior for variable selection in high-dimensional classification and data mining
• A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing
• Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
• Posterior contraction in sparse Bayesian factor models for massive covariance matrices
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• Minimax and Adaptive Inference in Nonparametric Function Estimation
• False discovery rate regression: an application to neural synchrony detection in primary visual cortex
• Bayesian shrinkage

Cited by in corpus (27)

• Bayesian linear regression with sparse priors
• The Horseshoe Estimator: Posterior Concentration around Nearly Black Vectors
• Empirical Bayes posterior concentration in sparse high-dimensional linear models
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• False confidence, non-additive beliefs, and valid statistical inference
• Conditions for Posterior Contraction in the Sparse Normal Means Problem
• Data-driven priors and their posterior concentration rates
• On the Beta Prime Prior for Scale Parameters in High-Dimensional Bayesian Regression Models
• Bayesian Sparse Linear Regression with Unknown Symmetric Error
• Empirical priors and coverage of posterior credible sets in a sparse normal mean model
• An empirical $G$-Wishart prior for sparse high-dimensional Gaussian graphical models
• Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
• Bayesian fractional posteriors
• Variational approximations of empirical Bayes posteriors in high-dimensional linear models
• Empirical priors for prediction in sparse high-dimensional linear regression
• General framework for projection structures
• Bayesian Bootstrap Spike-and-Slab LASSO
• Empirical priors and posterior concentration rates for a monotone density
• Empirical Bayes inference in sparse high-dimensional generalized linear models
• Empirical Bayes, SURE and Sparse Normal Mean Models
• A note on Bayesian convergence rates under local prior support conditions
• Minimax Posterior Convergence Rates and Model Selection Consistency in High-dimensional DAG Models based on Sparse Cholesky Factors
• Asymptotic Minimaxity, Optimal Posterior Concentration and Asymptotic Bayes Optimality of Horseshoe-type Priors Under Sparsity
• A Nonparametric Bayesian Approach for Sparse Sequence Estimation
• Asymptotically optimal inference in sparse sequence models with a simple data-dependent measure
• Robust W-GAN-Based Estimation Under Wasserstein Contamination
• Convergence Rates of Empirical Bayes Posterior Distributions: A Variational Perspective