activity
20182025
most citedOn the Generalization of Stochastic Gradient Descent with Momentum

11 citations · 44 across the 18 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.LG2024

Improving SAM Requires Rethinking its Optimization Formulation

Wanyun Xie, Fabian Latorre, Kimon Antonakopoulos +2

This paper rethinks Sharpness-Aware Minimization (SAM), which is originally formulated as a zero-sum game where the weights of a network and a bounded perturbation try to minimize/…

math.OC2024★ 1 cited

Universal Gradient Methods for Stochastic Convex Optimization

Anton Rodomanov, Ali Kavis, Yongtao Wu +2

We develop universal gradient methods for Stochastic Convex Optimization (SCO). Our algorithms automatically adapt not only to the oracle's noise but also to the Hölder smoothness…