most citedImproving the Adaptive Moment Estimation (ADAM) stochastic optimizer through an Implicit-Explicit (IMEX) time-stepping approach

5 citations · 5 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CE2024★ 5 cited

Improving the Adaptive Moment Estimation (ADAM) stochastic optimizer through an Implicit-Explicit (IMEX) time-stepping approach

Abhinab Bhattacharjee, Andrey A. Popov, Arash Sarshar +1

The Adam optimizer, often used in Machine Learning for neural network training, corresponds to an underlying ordinary differential equation (ODE) in the limit of very small learnin…