most citedOn the Convergence of Adaptive Gradient Methods for Nonconvex Optimization

78 citations · 78 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2018★ 78 cited

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization

Dongruo Zhou, Jinghui Chen, Yuan Cao +2

Adaptive gradient methods are workhorses in deep learning. However, the convergence guarantees of adaptive gradient methods for nonconvex optimization have not been thoroughly stud…