85 citations · 119 across the 9 of their papers we have counts for
1 paper · 1 filter
Inesh Chakrabarti, Sourjya Roy, Bowen Bao +3
Mixture-of-Experts (MoE) language models deliver high capacity at low per-token compute, but deploying them cheaply requires compressing their many expert weight matrices. Expert p…