A general system of differential equations to model first order adaptive algorithms

André Belotto da Silva, Maxime Gazeau

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iterat…