Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences

Abstract

We consider full Bayesian inference in the multivariate normal mean model in the situation that the mean vector is sparse. The prior distribution on the vector of means is constructed hierarchically by first choosing a collection of nonzero means and next a prior on the nonzero values. We consider the posterior distribution in the frequentist set-up that the observations are generated according to a fixed mean vector, and are interested in the posterior distribution of the number of nonzero components and the contraction of the posterior distribution to the true mean vector. We find various combinations of priors on the number of nonzero coefficients and on these coefficients that give desirable performance. We also find priors that give suboptimal convergence, for instance, Gaussian priors on the nonzero coefficients. We illustrate the results by simulations.

Published in at http://dx.doi.org/10.1214/12-AOS1029 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (8)

• Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• The sparsity and bias of the Lasso selection in high-dimensional linear regression
• General maximum likelihood empirical Bayes estimation of normal means
• Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
• Estimation and confidence sets for sparse normal mixtures
• On optimality of Bayesian testimation in the normal means problem
• Lower bounds for posterior rates with Gaussian process priors