5 papers · 1 filter
The Lasso error is bounded iff its active set size is bounded away from n in the proportional regime
Pierre C. Bellec
This note develops an analysis of the Lasso \( \hat b\) in linear models without any sparsity or L1 assumption on the true regression vector, in the proportional regime where dimen…
Phase transitions for the existence of unregularized M-estimators in single index models
Takuya Koriyama, Pierre C. Bellec
This paper studies phase transitions for the existence of unregularized M-estimators under proportional asymptotics where the sample size and feature dimension grow proport…
Simultaneous analysis of approximate leave-one-out cross-validation and mean-field inference
Pierre C Bellec
Approximate Leave-One-Out Cross-Validation (ALO-CV) is a method that has been proposed to estimate the generalization error of a regularized estimator in the high-dimensional regim…
Estimating Generalization Performance Along the Trajectory of Proximal SGD in Robust Regression
Kai Tan, Pierre C. Bellec
This paper studies the generalization performance of iterates obtained by Gradient Descent (GD), Stochastic Gradient Descent (SGD) and their proximal variants in high-dimensional r…
Precise Asymptotics of Bagging Regularized M-estimators
Takuya Koriyama, Pratik Patil, Jin-Hong Du +2
We characterize the squared prediction risk of ensemble estimators obtained through subagging (subsample bootstrap aggregating) regularized M-estimators and construct a consistent…