An Asynchronous Distributed Framework for Large-scale Learning Based on Parameter Exchanges

Bikash Joshi, Franck Iutzeler, Massih-Reza Amini

In many distributed learning problems, the heterogeneous loading of computing machines may harm the overall performance of synchronous strategies. In this paper, we propose an effe…