575 citations · 1k across the 18 of their papers we have counts for
5 papers · 1 filter
Advances and Open Problems in Federated Learning
Peter Kairouz, H. Brendan McMahan, Brendan Avent +56
Federated learning (FL) is a machine learning setting where many clients (e.g. mobile devices or whole organizations) collaboratively train a model under the orchestration of a cen…
Multi-Armed Bandits with Correlated Arms
Samarth Gupta, Shreyas Chaudhari, Gauri Joshi +1
We consider a multi-armed bandit framework where the rewards obtained by pulling different arms are correlated. We develop a unified approach to leverage these reward correlations…
Accelerating Deep Learning by Focusing on the Biggest Losers
Angela H. Jiang, Daniel L. -K. Wong, Giulio Zhou +8
This paper introduces Selective-Backprop, a technique that accelerates the training of deep neural networks (DNNs) by prioritizing examples with high loss at each iteration. Select…
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling
Jianyu Wang, Anit Kumar Sahu, Zhouyi Yang +2
This paper studies the problem of error-runtime trade-off, typically encountered in decentralized training based on stochastic gradient descent (SGD) using a given network. While a…
Service Rate Region of Content Access from Erasure Coded Storage
Sarah Anderson, Ann Johnston, Gauri Joshi +3
We consider storage systems in which files are stored over nodes. A node may be systematic for a particular file in the sense that access to it gives access to the file. Al…