Least angle and ${\ell }_1$ penalized regression: A review

Abstract

Least Angle Regression is a promising technique for variable selection applications, offering a nice alternative to stepwise regression. It provides an explanation for the similar behavior of LASSO (${\ell }_1$-penalized regression) and forward stagewise regression, and provides a fast implementation of both. The idea has caught on rapidly, and sparked a great deal of research interest. In this paper, we give an overview of Least Angle Regression and the current state of related research.

Published in at http://dx.doi.org/10.1214/08-SS035 the Statistics Surveys (http://www.i-journals.org/ss/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (25)

• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Rejoinder to "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• High-dimensional graphs and variable selection with the Lasso
• Pathwise coordinate optimization
• On the "degrees of freedom" of the lasso
• One-step sparse estimates in nonconcave penalized likelihood models
• Component selection and smoothing in multivariate nonparametric regression
• The sparsity and bias of the Lasso selection in high-dimensional linear regression
• Piecewise linear regularized solution paths
• Lasso-type recovery of sparse representations for high-dimensional data
• High-dimensional generalized linear models and the lasso
• Sparsity oracle inequalities for the Lasso
• Forward stagewise regression and the monotone lasso
• Discussion: The Dantzig selector: Statistical estimation when $p$ is much larger than $n$
• Discussion: One-step sparse estimates in nonconcave penalized likelihood models
• Discussion: A tale of three cousins: Lasso, L2Boosting and Dantzig
• Smoothing ${\ell }_1$-penalized estimators for high-dimensional time-course data

Cited by in corpus (11)

• A survey of cross-validation procedures for model selection
• Interpretable Classification Models for Recidivism Prediction
• Machine learning for industrial sensing and control: A survey and practical perspective
• Model selection for hybrid dynamical systems via sparse regression
• Spectral likelihood expansions for Bayesian inference
• Sparsity with sign-coherent groups of variables via the cooperative-Lasso
• Model selection of chaotic systems from data with hidden variables using sparse data assimilation
• Two-stage Sampling, Prediction and Adaptive Regression via Correlation Screening (SPARCS)
• A Scalable Empirical Bayes Approach to Variable Selection in Generalized Linear Models
• A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
• Regularization for the Approximation of 2D Set of Points via the Length of the Curve