Bilateral Sharpness-Aware Minimization for Flatter Minima

Jiaxin Deng, Junbiao Pang, Baochang Zhang +1

Sharpness-Aware Minimization (SAM) enhances generalization by reducing a Max-Sharpness (MaxS). Despite the practical success, we empirically found that the MAxS behind SAM's genera…