Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks

Jinping Zou, Xiaoge Deng, Tao Sun

Sharpness-Aware Minimization (SAM) has proven highly effective in improving model generalization in machine learning tasks. However, SAM employs a fixed hyperparameter associated w…