182 citations · 204 across the 11 of their papers we have counts for
1 paper · 1 filter
James Oldfield, Markos Georgopoulos, Grigorios G. Chrysos +5
The Mixture of Experts (MoE) paradigm provides a powerful way to decompose dense layers into smaller, modular computations often more amenable to human interpretation, debugging, a…