1 citations · 1 across the 13 of their papers we have counts for
1 paper · 1 filter
Ning Liao, Xiaoxing Wang, Xiaohan Qin +1
As revealed by the scaling law of fine-grained MoE, model performance ceases to be improved once the granularity of the intermediate dimension exceeds the optimal threshold, limiti…