2 citations · 6 across the 8 of their papers we have counts for
1 paper · 1 filter
Amelie Royer, Ilia Karmanov, Andrii Skliar +2
Mixture of Experts (MoE) are rising in popularity as a means to train extremely large-scale models, yet allowing for a reasonable computational cost at inference time. Recent state…