Pretraining Federated Text Models for Next Word Prediction

Joel Stremmel, Arjun Singh

Federated learning is a decentralized approach for training models on distributed devices, by summarizing local changes and sending aggregate parameters from local models to the cl…