Memorizing without overfitting: Bias, variance, and interpolation in over-parameterized models

Jason W. Rocks, Pankaj Mehta

The bias-variance trade-off is a central concept in supervised learning. In classical statistics, increasing the complexity of a model (e.g., number of parameters) reduces bias but…