185 citations · 236 across the 3 of their papers we have counts for
1 paper · 1 filter
Alexandre Défossez, Léon Bottou, Francis Bach +1
We provide a simple proof of convergence covering both the Adam and Adagrad adaptive optimization algorithms when applied to smooth (possibly non-convex) objective functions with b…