Negative Momentum for Convex-Concave Optimization

Henry Shugart, Shuyi Wang, Jason M. Altschuler

This paper revisits momentum in the context of min-max optimization. Momentum is a celebrated mechanism for accelerating gradient dynamics in settings like convex minimization, but…