33 citations · 46 across the 3 of their papers we have counts for
1 paper · 1 filter
Jerry Ma, Denis Yarats
Momentum-based acceleration of stochastic gradient descent (SGD) is widely used in deep learning. We propose the quasi-hyperbolic momentum algorithm (QHM) as an extremely simple al…