Learning between the peaks: sharp asymptotics for kernel ridge regression under power-law anisotropy

Lorenzo Rizzi, Arie Wortsman Zurich, Bruno Loureiro

We study kernel ridge regression under anisotropic Gaussian data, where the input covariance decays as a power law with exponent $\alpha \ge 0$ for polynomial inner-product kernels. We…