Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer

Peng Mi, Li Shen, Tianhe Ren +6

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the…