Least Squares Regression Can Exhibit Under-Parameterized Double Descent

Xinyue Li, Rishi Sonthalia

The relationship between the number of training data points, the number of parameters, and the generalization capabilities of models has been widely studied. Previous work has show…