134 citations · 141 across the 11 of their papers we have counts for
Showing math.OCShow all
2 papers · 1 filter
math.OC2020★ 2 cited
Adaptive Gradient Methods Can Be Provably Faster than SGD after Finite Epochs
Xunpeng Huang, Hao Zhou, Runxin Xu +2
Adaptive gradient methods have attracted much attention of machine learning communities due to the high efficiency. However their acceleration effect in practice, especially in neu…
math.OC2020★ 2 cited
SPAN: A Stochastic Projected Approximate Newton Method
Xunpeng Huang, Xianfeng Liang, Zhengyang Liu +4
Second-order optimization methods have desirable convergence properties. However, the exact Newton method requires expensive computation for the Hessian and its inverse. In this pa…