335 citations · 882 across the 15 of their papers we have counts for
9 papers · 1 filter
Towards Federated Learning Under Resource Constraints via Layer-wise Training and Depth Dropout
Pengfei Guo, Warren Richard Morningstar, Raviteja Vemulapalli +3
Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessib…
Federated Variational Inference: Towards Improved Personalization and Generalization
Elahe Vedadi, Joshua V. Dillon, Philip Andrew Mansfield +3
Conventional federated learning algorithms train a single global model by leveraging all participating clients' data. However, due to heterogeneity in client generative distributio…
Federated Training of Dual Encoding Models on Small Non-IID Client Datasets
Raviteja Vemulapalli, Warren Richard Morningstar, Philip Andrew Mansfield +4
Dual encoding models that encode a pair of inputs are widely used for representation learning. Many approaches train dual encoding models by maximizing agreement between pairs of e…
Plex: Towards Reliability using Pretrained Large Model Extensions
Dustin Tran, Jeremiah Liu, Michael W. Dusenberry +23
A recent trend in artificial intelligence is the use of pretrained models for language and vision tasks, which have achieved extraordinary performance but also puzzling failures. P…
Mixed Federated Learning: Joint Decentralized and Centralized Learning
Sean Augenstein, Andrew Hard, Lin Ning +4
Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixe…
What Do We Mean by Generalization in Federated Learning?
Honglin Yuan, Warren Morningstar, Lin Ning +1
Federated learning data is drawn from a distribution of distributions: clients are drawn from a meta-distribution, and their data are drawn from local data distributions. Thus gene…
Learning Federated Representations and Recommendations with Limited Negatives
Lin Ning, Karan Singhal, Ellie X. Zhou +1
Deep retrieval models are widely used for learning entity representations and recommendations. Federated learning provides a privacy-preserving way to train these models without re…
A Field Guide to Federated Optimization
Jianyu Wang, Zachary Charles, Zheng Xu +50
Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data, motivated by and designed for privacy prote…
Federated Reconstruction: Partially Local Federated Learning
Karan Singhal, Hakim Sidahmed, Zachary Garrett +3
Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client hetero…