On Fundamental Proof Structures in First-Order Optimization

Baptiste Goujaud, Aymeric Dieuleveut, Adrien Taylor

First-order optimization methods have attracted a lot of attention due to their practical success in many applications, including in machine learning. Obtaining convergence guarant…