A Scalable Empirical Bayes Approach to Variable Selection in Generalized Linear Models
arXiv:1803.09735 · doi:10.1080/10618600.2019.1706542
Abstract
A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much larger than the number of responses. The coefficients in the linear predictor are modeled as a three-component mixture allowing the explanatory variables to have a random positive effect on the response, a random negative effect, or no effect. A key assumption is that only a small (but unknown) fraction of the candidate variables have a non-zero effect. This assumption, in addition to treating the coefficients as random effects facilitates an approach that is computationally efficient. In particular, the number of parameters that have to be estimated is small, and remains constant regardless of the number of explanatory variables. The model parameters are estimated using a Generalized Alternating Maximization algorithm which is scalable, and leads to significantly faster convergence compared with simulation-based fully Bayesian methods.
arXiv commentarXiv admin note: text overlap with arXiv:1510.03781
References in corpus (20)
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Nearly unbiased variable selection under minimax concave penalty
- Spike and slab variable selection: Frequentist and Bayesian strategies
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
- Bayesian variable selection regression for genome-wide association studies and other large-scale problems
- SLOPE - Adaptive variable selection via convex optimization
- Least angle and penalized regression: A review
- Hypothesis test for normal mixture models: The EM approach
- A simple forward selection procedure based on false discovery rate control
- Conditions for Posterior Contraction in the Sparse Normal Means Problem
- The Inverse Gamma-Gamma Prior for Optimal Posterior Contraction and Multiple Hypothesis Testing