2 citations · 3 across the 14 of their papers we have counts for
Showing 2024 · math.OCShow all
2 papers · 2 filters
math.OC2024★ 2 cited
Convergence rates for the Adam optimizer
Steffen Dereich, Arnulf Jentzen
Stochastic gradient descent (SGD) optimization methods are nowadays the method of choice for the training of deep neural networks (DNNs) in artificial intelligence systems. In prac…
math.OC2024
Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses
Steffen Dereich, Arnulf Jentzen, Adrian Riekert
The standard stochastic gradient descent (SGD) optimization method, as well as adaptive methods such as the Adam optimizer fail to converge if the learning rates do not converge to…