AutoDDL: Automatic Distributed Deep Learning with Near-Optimal Bandwidth Cost

Jinfan Chen, Shigang Li, Ran Gun +2

Recent advances in deep learning are driven by the growing scale of computation, data, and models. However, efficiently training large-scale models on distributed systems requires…