Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization

Yutong Wang, Rishi Sonthalia, Wei Hu

We study the generalization capability of nearly-interpolating linear regressors: $\mathbf{\beta }$'s whose training error $\tau$ is positive but small, i.e., below the noise floor. Unde…