9 citations · 9 across the 6 of their papers we have counts for
3 papers · 1 filter
Rethinking the Variational Interpretation of Nesterov's Accelerated Method
Peiyuan Zhang, Antonio Orvieto, Hadi Daneshmand
The continuous-time model of Nesterov's momentum provides a thought-provoking perspective for understanding the nature of the acceleration phenomenon in convex optimization. One of…
Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization
Peiyuan Zhang, Antonio Orvieto, Hadi Daneshmand +2
Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order…
Mixing of Stochastic Accelerated Gradient Descent
Peiyuan Zhang, Hadi Daneshmand, Thomas Hofmann
We study the mixing properties for stochastic accelerated gradient descent (SAGD) on least-squares regression. First, we show that stochastic gradient descent (SGD) and SAGD are si…