Failure and success of the spectral bias prediction for Kernel Ridge Regression: the case of low-dimensional data

Umberto M. Tomasini, Antonio Sclocchi, Matthieu Wyart

Recently, several theories including the replica method made predictions for the generalization error of Kernel Ridge Regression. In some regimes, they predict that the method has…