Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Continual Classification Beyond the Kernel Regime: Harnessing the Sparsity Bias of L2 Regularization in Diagonal Linear Networks
Gilad Karpel, Itay Evron, Ron Meir +1
We study logistic regression for continual learning with linear predictors in a high-dimensional statistical setting. Existing theoretical work has largely focused on continual lin…
cs.LG2026
Optimal Explicit and Implicit Regularization Strengths in High-Dimensional Continual Linear Regression
Gilad Karpel, Daniel Soudry
We study continual linear regression in a high-dimensional regime, where a learner observes a sequence of tasks and updates its parameters sequentially. In this setting, we derive…
cs.LG2026
Optimal L2 Regularization in High-dimensional Continual Linear Regression
Gilad Karpel, Edward Moroshko, Ran Levinstein +3
We study generalization in an overparameterized continual linear regression setting, where a model is trained with L2 (isotropic) regularization across a sequence of tasks. We deri…