Frequency-Domain Representation of First-Order Methods: A Simple and Robust Framework of Analysis

Ioannis Anagnostides, Ioannis Panageas

Motivated by recent applications in min-max optimization, we employ tools from nonlinear control theory in order to analyze a class of "historical" gradient-based methods, for whic…