most citedMXNET-MPI: Embedding MPI parallelism in Parameter Server Task Model for scaling Deep Learning

18 citations · 18 across the 1 of their papers we have counts for

collaborators

1 paper

cs.DC2018★ 18 cited

MXNET-MPI: Embedding MPI parallelism in Parameter Server Task Model for scaling Deep Learning

Amith R Mamidala, Georgios Kollias, Chris Ward +1

Existing Deep Learning frameworks exclusively use either Parameter Server(PS) approach or MPI parallelism. In this paper, we discuss the drawbacks of such approaches and propose a…