121 citations · 155 across the 14 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2021★ 13 cited
ScaleCom: Scalable Sparsified Gradient Compression for Communication-Efficient Distributed Training
Chia-Yu Chen, Jiamin Ni, Songtao Lu +8
Large-scale distributed training of Deep Neural Networks (DNNs) on state-of-the-art platforms is expected to be severely communication constrained. To overcome this limitation, num…
cs.LG2020★ 1 cited
Improving Efficiency in Large-Scale Decentralized Distributed Training
Wei Zhang, Xiaodong Cui, Abdullah Kayi +9
Decentralized Parallel SGD (D-PSGD) and its asynchronous variant Asynchronous Parallel SGD (AD-PSGD) is a family of distributed learning algorithms that have been demonstrated to p…
cs.LG2018
Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks
Xiaodong Cui, Wei Zhang, Zoltán Tüske +1
We propose a population-based Evolutionary Stochastic Gradient Descent (ESGD) framework for optimizing deep neural networks. ESGD combines SGD and gradient-free evolutionary algori…