Sparsity-Adaptive Sharpness-Aware Minimization

Shiryu Ueno, Yoshikazu Hayashi, Kunihito Kato

Deploying deep neural networks in real-world settings requires models that are both compact and robust to common corruptions. However, at deployment-relevant high sparsity, standar…