selectBoost: a general algorithm to enhance the performance of variable selection methods in correlated datasets
arXiv:1810.01670 · doi:10.1093/bioinformatics/btaa855
Abstract
Motivation: With the growth of big data, variable selection has become one of the major challenges in statistics. Although many methods have been proposed in the literature their performance in terms of recall and precision are limited in a context where the number of variables by far exceeds the number of observations or in a high correlated setting. Results: In this article, we propose a general algorithm which improves the precision of any existing variable selection method. This algorithm is based on highly intensive simulations and takes into account the correlation structure of the data. Our algorithm can either produce a confidence index for variable selection or it can be used in an experimental design planning perspective. We demonstrate the performance of our algorithm on both simulated and real data.
arXiv commentThis article supersedes arXiv:1512.03307
References in corpus (16)
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Finding community structure in very large networks
- Nearly unbiased variable selection under minimax concave penalty
- A note on the group lasso and a sparse group lasso
- Bayesian variable selection regression for genome-wide association studies and other large-scale problems
- Random lasso
- A new Universal Resample Stable Bootstrap-based Stopping Criterion in PLS Components Construction