Potential Function-based Framework for Making the Gradients Small in Convex and Min-Max Optimization

Jelena Diakonikolas, Puqian Wang

Making the gradients small is a fundamental optimization problem that has eluded unifying and simple convergence arguments in first-order optimization, so far primarily reserved fo…