Gear Training: A new way to implement high-performance model-parallel training

Hao Dong, Shuai Li, Dongchang Xu +2

The training of Deep Neural Networks usually needs tremendous computing resources. Therefore many deep models are trained in large cluster instead of single machine or GPU. Though…