4 papers
Fundamental Limits of Distributed Linearly Separable Computation under Cyclic Assignment
Wenbo Huang, Kai Wan, Hua Sun +3
This paper studies the master-worker distributed linearly separable computation problem, where the considered computation task, referred to as linearly separable function, is a typ…
A Unified Analysis of Federated Learning with Arbitrary Client Participation
Shiqiang Wang, Mingyue Ji
Federated learning (FL) faces challenges of intermittent client availability and computation/communication efficiency. As a result, only a small subset of clients can participate i…
Fundamental Limits of Multi-Message Private Computation
Ali Gholami, Kai Wan, Tayyebeh Jahani-Nezhad +3
In a typical formulation of the private information retrieval (PIR) problem, a single user wishes to retrieve one out of files from servers without revealing the demanded…
Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD
Jiayi Wang, Shiqiang Wang, Rong-Rong Chen +1
Hierarchical SGD (H-SGD) has emerged as a new distributed SGD algorithm for multi-level communication networks. In H-SGD, before each global aggregation, workers send their updated…