80 citations · 110 across the 8 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
math.OC2020★ 1 cited
High Probability Convergence Bounds for Non-convex Stochastic Gradient Descent with Sub-Weibull Noise
Liam Madden, Emiliano Dall'Anese, Stephen Becker
Stochastic gradient descent is one of the most common iterative algorithms used in machine learning and its convergence analysis is a rich area of research. Understanding its conve…
math.OC2020★ 12 cited
Bounds for the tracking error of first-order online optimization methods
Liam Madden, Stephen Becker, Emiliano Dall'Anese
This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assu…