Aggregation of supports along the Lasso path
arXiv:1602.03427
Abstract
In linear regression with fixed design, we propose two procedures that aggregate a data-driven collection of supports. The collection is a subset of the possible supports and both its cardinality and its elements can depend on the data. The procedures satisfy oracle inequalities with no assumption on the design matrix. Then we use these procedures to aggregate the supports that appear on the regularization path of the Lasso in order to construct an estimator that mimics the best Lasso estimator. If the restricted eigenvalue condition on the design matrix is satisfied, then this estimator achieves optimal prediction bounds. Finally, we discuss the computational cost of these procedures.
References in corpus (16)
- Discussion of "Least angle regression" by Efron et al
- Rejoinder to "Least angle regression" by Efron et al
- Least Angle Regression
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Discussion of "Least angle regression" by Efron et al
- Simultaneous analysis of Lasso and Dantzig selector
- On the Prediction Performance of the Lasso
- Exponential Screening and optimal rates of sparse estimation
- Complexity Analysis of the Lasso Regularization Path
- Deviation optimal learning using greedy Q-aggregation
- Robust sketching for multiple square-root LASSO problems