Distributed Training of Deep Learning Models: A Taxonomic Perspective

Matthias Langer, Zhen He, Wenny Rahayu +1

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decision…