82 citations · 103 across the 15 of their papers we have counts for
Showing stat.MLShow all
3 papers · 1 filter
stat.ML2024
Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression
Jackie Lok, Rishi Sonthalia, Elizaveta Rebrova
We study the discrete dynamics of mini-batch gradient descent with random reshuffling for least squares regression. We show that the training and generalization errors depend on a…
stat.ML2024
Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization
Yutong Wang, Rishi Sonthalia, Wei Hu
We study the generalization capability of nearly-interpolating linear regressors: 's whose training error is positive but small, i.e., below the noise floor. Unde…
stat.ML2023★ 1 cited
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
Xinyue Li, Rishi Sonthalia
The relationship between the number of training data points, the number of parameters, and the generalization capabilities of models has been widely studied. Previous work has show…