Bayesian Variable Selection and Estimation for Group Lasso

Abstract

The paper revisits the Bayesian group lasso and uses spike and slab priors for group variable selection. In the process, the connection of our model with penalized regression is demonstrated, and the role of posterior median for thresholding is pointed out. We show that the posterior median estimator has the oracle property for group variable selection and estimation under orthogonal designs, while the group lasso has suboptimal asymptotic estimation rate when variable selection consistency is achieved. Next we consider bi-level selection problem and propose the Bayesian sparse group selection again with spike and slab priors to select variables both at the group level and also within a group. We demonstrate via simulation that the posterior median estimator of our spike and slab models has excellent performance for both variable selection and estimation.

Published at http://dx.doi.org/10.1214/14-BA929 in the Bayesian Analysis (http://projecteuclid.org/euclid.ba) by the International Society of Bayesian Analysis (http://bayesian.org/)

References in corpus (2)

• A Selective Review of Group Selection in High-Dimensional Models
• Needles and Straw in a Haystack: Posterior concentration for possibly sparse sequences

Cited by in corpus (10)

• State-of-the-Art Methods for Exposure-Health Studies: results from the Exposome Data Challenge Event
• High-Dimensional Multivariate Posterior Consistency Under Global-Local Shrinkage Priors
• Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
• Bayesian Effect Selection in Structured Additive Distributional Regression Models
• Group Inverse-Gamma Gamma Shrinkage for Sparse Regression with Block-Correlated Predictors
• Variational Inference of Structured Line Spectra Exploiting Group-Sparsity
• A Nonparametric Bayesian Technique for High-Dimensional Regression
• Spike-and-Slab LASSO Generalized Additive Models and Scalable Algorithms for High-Dimensional Data Analysis
• Robust Bayesian causal estimation for causal inference in medical diagnosis
• Group Spike and Slab Variational Bayes