activity
20162023
most citedATOMO: Communication-efficient Learning via Atomic Sparsification

198 citations · 764 across the 28 of their papers we have counts for

collaborators
Showing 2021Show all

5 papers · 1 filter

math.OC2021

Iterated Vector Fields and Conservatism, with Applications to Federated Learning

Zachary Charles, Keith Rush

We study whether iterated vector fields (vector fields composed with themselves) are conservative. We give explicit examples of vector fields for which this self-composition preser…

cs.LG2021★ 167 cited

A Field Guide to Federated Optimization

Jianyu Wang, Zachary Charles, Zheng Xu +50

Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data, motivated by and designed for privacy prote…

cs.LG2021★ 3 cited

On Large-Cohort Training for Federated Learning

Zachary Charles, Zachary Garrett, Zhouyuan Huo +2

Federated learning methods typically learn a model by iteratively sampling updates from a population of clients. In this work, we explore how the number of clients sampled at each…

cs.LG2021★ 21 cited

Local Adaptivity in Federated Learning: Convergence and Consistency

Jianyu Wang, Zheng Xu, Zachary Garrett +3

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Pop…

cs.LG2021★ 7 cited

Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning

Zachary Charles, Jakub Konečný

We study a family of algorithms, which we refer to as local update methods, generalizing many federated and meta-learning algorithms. We prove that for quadratic models, local upda…