Scaling Language Model Size in Cross-Device Federated Learning

Jae Hun Ro, Theresa Breiner, Lara McConnaughey +4

Most studies in cross-device federated learning focus on small models, due to the server-client communication and on-device computation bottlenecks. In this work, we leverage vario…