Kernel ridge regression under power-law data: spectrum and generalization

Arie Wortsman, Bruno Loureiro

In this work, we investigate high-dimensional kernel ridge regression (KRR) on i.i.d. Gaussian data with anisotropic power-law covariance. This setting differs fundamentally from t…