An improvement of the convergence proof of the ADAM-Optimizer

Sebastian Bock, Josef Goppold, Martin Weiß

A common way to train neural networks is the Backpropagation. This algorithm includes a gradient descent method, which needs an adaptive step size. In the area of neural networks,…