9 citations · 11 across the 5 of their papers we have counts for
Showing math.OCShow all
2 papers · 1 filter
math.OC2020
ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization
Xunpeng Huang, Runxin Xu, Hao Zhou +3
Due to its simplicity and outstanding ability to generalize, stochastic gradient descent (SGD) is still the most widely used optimization method despite its slow convergence. Meanw…
math.OC2020★ 2 cited
SPAN: A Stochastic Projected Approximate Newton Method
Xunpeng Huang, Xianfeng Liang, Zhengyang Liu +4
Second-order optimization methods have desirable convergence properties. However, the exact Newton method requires expensive computation for the Hessian and its inverse. In this pa…