Adaptive group-regularized logistic elastic net regression
arXiv:1805.00389 · doi:10.1093/biostatistics/kxz062
Abstract
In high-dimensional data settings, additional information on the features is often available. Examples of such external information in omics research are: (a) p-values from a previous study, (b) a summary of prior information, and (c) omics annotation. The inclusion of this information in the analysis may enhance classification performance and feature selection, but is not straightforward in the standard regression setting. As a solution to this problem, we propose a group-regularized (logistic) elastic net regression method, where each penalty parameter corresponds to a group of features based on the external information. The method, termed gren, makes use of the Bayesian formulation of logistic elastic net regression to estimate both the model and penalty parameters in an approximate empirical-variational Bayes framework. Simulations and an application to a colon cancer microRNA study show that, if the partitioning of the features is informative, classification performance and feature selection are indeed enhanced.
arXiv comment19 pages, 5 figures, supplementary material available from first author's personal website
References in corpus (6)
- Variational Inference: A Review for Statisticians
- On the adaptive elastic-net with a diverging number of parameters
- A Selective Review of Group Selection in High-Dimensional Models
- Bayesian linear regression with sparse priors
- The Horseshoe Estimator: Posterior Concentration around Nearly Black Vectors
- Overlapping group logistic regression with applications to genetic pathway selection