78 citations · 177 across the 10 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 6 cited
Restructuring, Pruning, and Adjustment of Deep Models for Parallel Distributed Inference
Afshin Abdi, Saeed Rashidi, Faramarz Fekri +1
Using multiple nodes and parallel computing algorithms has become a principal tool to improve training and execution times of deep neural networks as well as effective collective i…
cs.AR2020★ 40 cited
Enabling Compute-Communication Overlap in Distributed Deep Learning Training Platforms
Saeed Rashidi, Matthew Denton, Srinivas Sridharan +4
Deep Learning (DL) training platforms are built by interconnecting multiple DL accelerators (e.g., GPU/TPU) via fast, customized interconnects with 100s of gigabytes (GBs) of bandw…