5.2k citations · 7.8k across the 38 of their papers we have counts for
1 paper · 1 filter
Alexandre Défossez, Léon Bottou, Francis Bach +1
We provide a simple proof of convergence covering both the Adam and Adagrad adaptive optimization algorithms when applied to smooth (possibly non-convex) objective functions with b…