Convergence of ADAM for Lipschitz Objective Functions

Juan Ferrera, Javier Gómez Gil

The aim of this paper is to prove the exponential convergence, local and global, of Adam algorithm under precise conditions on the parameters, when the objective function lacks dif…