203 citations · 593 across the 26 of their papers we have counts for
Showing 2019 · cs.DCShow all
2 papers · 2 filters
cs.DC2019★ 2 cited
The Scalability for Parallel Machine Learning Training Algorithm: Dataset Matters
Daning Cheng, Hanping Zhang, Fen Xia +2
To gain a better performance, many researchers put more computing resource into an application. However, in the AI area, there is still a lack of a successful large-scale machine l…
cs.DC2019★ 55 cited
Taming Unbalanced Training Workloads in Deep Learning with Partial Collective Operations
Shigang Li, Tal Ben-Nun, Salvatore Di Girolamo +2
Load imbalance pervasively exists in distributed deep learning training systems, either caused by the inherent imbalance in learned tasks or by the system itself. Traditional synch…