Generalization for Least Squares Regression With Simple Spiked Covariances

Jiping Li, Rishi Sonthalia

Random matrix theory has proven to be a valuable tool in analyzing the generalization of linear models. However, the generalization properties of even two-layer neural networks tra…