67 citations · 79 across the 6 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2024
Nezha: Breaking Multi-Rail Network Barriers for Distributed DNN Training
Enda Yu, Dezun Dong, Xiangke Liao
In distributed deep learning, communication remains a critical bottleneck. While modern hardware advances rapidly, over 60 percent of production HPC systems still rely on legacy in…
cs.DC2020★ 67 cited
Communication optimization strategies for distributed deep neural network training: A survey
Shuo Ouyang, Dezun Dong, Yemao Xu +1
Recent trends in high-performance computing and deep learning have led to the proliferation of studies on large-scale deep neural network training. However, the frequent communicat…