Throughput Prediction of Asynchronous SGD in TensorFlow

Zhuojin Li, Wumo Yan, Marco Paolieri +1

Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing t…