Proteus: Simulating the Performance of Distributed DNN Training

Jiangfei Duan, Xiuhong Li, Ping Xu +4

DNN models are becoming increasingly larger to achieve unprecedented accuracy, and the accompanying increased computation and memory requirements necessitate the employment of mass…