3 citations · 9 across the 9 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
SAMPa: Sharpness-aware Minimization Parallelized
Wanyun Xie, Thomas Pethick, Volkan Cevher
Sharpness-aware minimization (SAM) has been shown to improve the generalization of neural networks. However, each SAM update requires \emph{sequentially} computing two gradients, e…
cs.LG2024
Improving SAM Requires Rethinking its Optimization Formulation
Wanyun Xie, Fabian Latorre, Kimon Antonakopoulos +2
This paper rethinks Sharpness-Aware Minimization (SAM), which is originally formulated as a zero-sum game where the weights of a network and a bounded perturbation try to minimize/…