Robust Synchronisation for Federated Learning in The Face of Correlated Device Failure

Stefan Behfar, Richard Mortier

Probabilistic Synchronous Parallel (PSP) is a technique in distributed learning systems to reduce synchronization bottlenecks by sampling a subset of participating nodes per round.…