Distributed Learning over Unreliable Networks

Chen Yu, Hanlin Tang, Cedric Renggli +5

Most of today's distributed machine learning systems assume {\em reliable networks}: whenever two machines exchange information (e.g., gradients or models), the network should guar…