Fast and Straggler-Tolerant Distributed SGD with Reduced Computation Load

Maximilian Egger, Serge Kas Hanna, Rawad Bitar

In distributed machine learning, a central node outsources computationally expensive calculations to external worker nodes. The properties of optimization procedures like stochasti…