Convergence of Momentum-Based Optimization Algorithms with Time-Varying Parameters

Mathukumalli Vidyasagar

In this paper, we present a unified algorithm for stochastic optimization that makes use of a "momentum" term; in other words, the stochastic gradient depends not only on the curre…