activity
20222025
most citedFLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

22 citations · 35 across the 7 of their papers we have counts for

collaborators
Showing 2023 · cs.LGShow all

1 paper · 2 filters

cs.LG2023★ 1 cited

Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings

Yehya Farhat, Hamza ElMokhtar Shili, Fangshuo Liao +7

Mixture-of-Experts (MoEs) achieve scalability by dynamically activating subsets of their components. Yet, understanding how expertise emerges through joint training of gating mecha…