High-Dimensional Inference Based on the Leave-One-Covariate-Out LASSO Path

Abstract

We propose a new measure of variable importance in high-dimensional regression based on the change in the LASSO solution path when one covariate is left out. The proposed procedure provides a novel way to calculate variable importance and conduct variable screening. In addition, our procedure allows for the construction of P-values for testing whether each coefficient is equal to zero as well as for testing hypotheses involving multiple regression coefficients simultaneously; bootstrap techniques are used to construct the null distribution. For low-dimensional linear models, our method can achieve higher power than the $t$-test. Extensive simulations are provided to show the effectiveness of our method. In the high-dimensional setting, our proposed solution path based test achieves greater power than some other recently developed high-dimensional inference methods.

arXiv comment24 pages, 8 figures

References in corpus (5)

• All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Sure independence screening in generalized linear models with NP-dimensionality
• A significance test for the lasso
• Covariate assisted screening and estimation