Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting

Jiping Li, Rishi Sonthalia

This paper analyzes the generalization error of minimum-norm interpolating solutions in linear regression using spiked covariance data models. The paper characterizes how varying s…