Bayesian high-dimensional linear regression with generic spike-and-slab priors

Abstract

Spike-and-slab priors are popular Bayesian solutions for high-dimensional linear regression problems. Previous theoretical studies on spike-and-slab methods focus on specific prior formulations and use prior-dependent conditions and analyses, and thus can not be generalized directly. In this paper, we propose a class of generic spike-and-slab priors and develop a unified framework to rigorously assess their theoretical properties. Technically, we provide general conditions under which generic spike-and-slab priors can achieve the nearly-optimal posterior contraction rate and the model selection consistency. Our results include those of Narisetty and He (2014) and Castillo et al. (2015) as special cases.

17 pages for main file, 13 pages for appendix

References in corpus (5)

• Nearly unbiased variable selection under minimax concave penalty
• Simultaneous analysis of Lasso and Dantzig selector
• Bayesian variable selection with shrinking and diffusing priors
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences
• Nearly optimal Bayesian Shrinkage for High Dimensional Regression