94 citations · 355 across the 30 of their papers we have counts for
3 papers · 1 filter
Throughput-Optimal Topology Design for Cross-Silo Federated Learning
Othmane Marfoq, Chuan Xu, Giovanni Neglia +1
Federated learning usually employs a client-server architecture where an orchestrator iteratively aggregates model updates from remote clients and pushes them back a refined model.…
Dynamic backup workers for parallel machine learning
Chuan Xu, Giovanni Neglia, Nicola Sebastianelli
The most popular framework for distributed training of machine learning models is the (synchronous) parameter server (PS). This paradigm consists of workers, which iteratively…
Decentralized gradient methods: does topology matter?
Giovanni Neglia, Chuan Xu, Don Towsley +1
Consensus-based distributed optimization methods have recently been advocated as alternatives to parameter server and ring all-reduce paradigms for large scale training of machine…