most citedNon-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates

1 citations · 1 across the 2 of their papers we have counts for

collaborators
Showing math.OCShow all

1 paper · 1 filter

math.OC2025

Asymptotic stability properties and a priori bounds for Adam and other gradient descent optimization methods

Steffen Dereich, Robin Graeber, Arnulf Jentzen +1

Gradient descent (GD) based optimization methods are these days the standard tools to train deep neural networks in artificial intelligence systems. In optimization procedures in d…