4 citations · 5 across the 3 of their papers we have counts for
Showing math.OCShow all
2 papers · 1 filter
math.OC2022
Zeroth-Order Randomized Subspace Newton Methods
Erik Berglund, Sarit Khirirat, Xiaoyu Wang
Zeroth-order methods have become important tools for solving problems where we have access only to function evaluations. However, the zeroth-order methods only using gradient appro…
math.OC2021★ 4 cited
On the Convergence of Step Decay Step-Size for Stochastic Optimization
Xiaoyu Wang, Sindri Magnússon, Mikael Johansson
The convergence of stochastic gradient descent is highly dependent on the step-size, especially on non-convex problems such as neural network training. Step decay step-size schedul…