Dynamic backup workers for parallel machine learning

Chuan Xu, Giovanni Neglia, Nicola Sebastianelli

The most popular framework for distributed training of machine learning models is the (synchronous) parameter server (PS). This paradigm consists of $n$ workers, which iteratively…