399 citations · 1.5k across the 18 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.DC2020★ 4 cited
APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm
Hanlin Tang, Shaoduo Gan, Samyam Rajbhandari +4
Adam is the important optimization algorithm to guarantee efficiency and accuracy for training many important tasks such as BERT and ImageNet. However, Adam is generally not compat…
stat.ML2020★ 14 cited
Stochastic Recursive Momentum for Policy Gradient Methods
Huizhuo Yuan, Xiangru Lian, Ji Liu +1
In this paper, we propose a novel algorithm named STOchastic Recursive Momentum for Policy Gradient (STORM-PG), which operates a SARAH-type stochastic recursive variance-reduced po…
stat.ML2020★ 4 cited
Stochastic Recursive Variance Reduction for Efficient Smooth Non-Convex Compositional Optimization
Huizhuo Yuan, Xiangru Lian, Ji Liu
Stochastic compositional optimization arises in many important machine learning tasks such as value function evaluation in reinforcement learning and portfolio management. The obje…