Understanding SAM's Robustness to Noisy Labels through Gradient Down-weighting

Hoang-Chau Luong, Quang-Thuc Nguyen, Dat Ba Tran +1

Sharpness-Aware Minimization (SAM) was introduced to improve generalization by seeking flat minima, yet it also exhibits robustness to label noise, a phenomenon that remains only p…