76 citations · 106 across the 13 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022
SP2: A Second Order Stochastic Polyak Method
Shuang Li, William J. Swartworth, Martin Takáč +2
Recently the "SP" (Stochastic Polyak step size) method has emerged as a competitive adaptive method for setting the step sizes of SGD. SP can be interpreted as a method specialized…
math.OC2022
Local and Global Convergence of General Burer-Monteiro Tensor Optimizations
Shuang Li, Qiuwei Li
Tensor optimization is crucial to massive machine learning and signal processing tasks. In this paper, we consider tensor optimization with a convex and well-conditioned objective…