Robust Fully-Asynchronous Methods for Distributed Training over General Architecture

Zehan Zhu, Ye Tian, Yan Huang +2

Perfect synchronization in distributed machine learning problems is inefficient and even impossible due to the existence of latency, package losses and stragglers. We propose a Rob…