74 citations · 170 across the 14 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017★ 20 cited
Fast Stochastic Variance Reduced Gradient Method with Momentum Acceleration for Machine Learning
Fanhua Shang, Yuanyuan Liu, James Cheng +1
Recently, research on accelerated stochastic gradient descent methods (e.g., SVRG) has made exciting progress (e.g., linear convergence for strongly convex problems). However, the…
cs.LG2017★ 2 cited
Guaranteed Sufficient Decrease for Variance Reduced Stochastic Gradient Descent
Fanhua Shang, Yuanyuan Liu, James Cheng +2
In this paper, we propose a novel sufficient decrease technique for variance reduced stochastic gradient descent methods such as SAG, SVRG and SAGA. In order to make sufficient dec…