21 citations · 21 across the 3 of their papers we have counts for
1 paper · 1 filter
Enric Boix-Adsera, Philippe Rigollet
Mixture-of-Experts (MoE) layers are increasingly central to frontier model architectures. By selectively activating parameters, they reduce computational cost while scaling total p…