Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers

Chinmaya Kausik, Kashvi Srivastava, Rishi Sonthalia

Despite the importance of denoising in modern machine learning and ample empirical work on supervised denoising, its theoretical understanding is still relatively scarce. One conce…