208 citations · 299 across the 14 of their papers we have counts for
Showing 2019 · cs.LGShow all
3 papers · 2 filters
cs.LG2019★ 208 cited
GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing
Jian Guo, He He, Tong He +13
We present GluonCV and GluonNLP, the deep learning toolkits for computer vision and natural language processing based on Apache MXNet (incubating). These toolkits provide state-of-…
cs.LG2019★ 1 cited
Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning
Shuai Zheng, James T. Kwok
Stochastic methods with coordinate-wise adaptive stepsize (such as RMSprop and Adam) have been widely used in training deep neural networks. Despite their fast convergence, they ca…
cs.LG2019★ 67 cited
Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback
Shuai Zheng, Ziyue Huang, James T. Kwok
Communication overhead is a major bottleneck hampering the scalability of distributed machine learning systems. Recently, there has been a surge of interest in using gradient compr…