2 papers
math.OC2025
Convergence of Momentum-Based Optimization Algorithms with Time-Varying Parameters
Mathukumalli Vidyasagar
In this paper, we present a unified algorithm for stochastic optimization that makes use of a "momentum" term; in other words, the stochastic gradient depends not only on the curre…
math.OC2025
Convergence of the Stochastic Heavy Ball Method With Approximate Gradients and/or Block Updating
Uday Kiran Reddy Tadipatri, Mathukumalli Vidyasagar
In this paper, we establish the convergence of the stochastic Heavy Ball (SHB) algorithm under more general conditions than in the current literature. Specifically, (i) The stochas…