4 citations · 23 across the 39 of their papers we have counts for
1 paper · 1 filter
Nam V. Nguyen, Huy Nguyen, Quang Pham +3
Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, we argue that ef…