5 citations · 16 across the 38 of their papers we have counts for
1 paper · 1 filter
Yaoxiang Wang, Kai Zhang, Ruobing Xie +4
Fine-grained mixture-of-experts (MoE) models commonly increase expert count by narrowing each expert, treating expert shape as a by-product of routing granularity. LatentMoE moves…