Efficient Language Model Architectures for Differentially Private Federated Learning

Jae Hun Ro, Srinadh Bhojanapalli, Zheng Xu +2

Cross-device federated learning (FL) is a technique that trains a model on data distributed across typically millions of edge devices without data leaving the devices. SGD is the s…