24 citations · 31 across the 3 of their papers we have counts for
1 paper · 1 filter
Amelie Royer, Ilia Karmanov, Andrii Skliar +2
Mixture of Experts (MoE) are rising in popularity as a means to train extremely large-scale models, yet allowing for a reasonable computational cost at inference time. Recent state…