222 citations · 604 across the 28 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2021★ 1 cited
Rethinking Adam: A Twofold Exponential Moving Average Approach
Yizhou Wang, Yue Kang, Can Qin +4
Adaptive gradient methods, e.g. \textsc{Adam}, have achieved tremendous success in machine learning. Scaling the learning rate element-wisely by a certain form of second moment est…
cs.LG2021★ 2 cited
Recent Advances on Neural Network Pruning at Initialization
Huan Wang, Can Qin, Yue Bai +2
Neural network pruning typically removes connections or neurons from a pretrained converged model; while a new pruning paradigm, pruning at initialization (PaI), attempts to prune…