34 citations · 36 across the 2 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2023★ 2 cited
Comprehensive Deadlock Prevention for GPU Collective Communication
Lichen Pan, Juncheng Liu, Yongquan Fu +4
Distributed deep neural network training necessitates efficient GPU collective communications, which are inherently susceptible to deadlocks. GPU collective deadlocks arise easily…
cs.DC2021★ 34 cited
OneFlow: Redesign the Distributed Deep Learning Framework from Scratch
Jinhui Yuan, Xinqi Li, Cheng Cheng +9
Deep learning frameworks such as TensorFlow and PyTorch provide a productive interface for expressing and training a deep neural network (DNN) model on a single device or using dat…