High-Dimensional Interpolators Can Be Fragile: Heavy Tails and High-Dimensional Large Deviations

Youheng Zhu, Yiping Lu

High-dimensional interpolation is common in modern machine learning, but its tail risk is less understood than its expected prediction risk. Existing theory shows that interpolatin…