2 citations · 2 across the 5 of their papers we have counts for
1 paper · 2 filters
Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi +3
In current Mixture-of-Experts architectures, routing is performed based on representations dominated by structure shared across all tokens, limiting expert specialization. We show…