activity
20232026
most citedDistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models

13 citations · 24 across the 8 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2023

Adaptive Gating in Mixture-of-Experts based Language Models

Jiamin Li, Qiang Su, Yitao Yang +3

Large language models, such as OpenAI's ChatGPT, have demonstrated exceptional language understanding capabilities in various NLP tasks. Sparsely activated mixture-of-experts (MoE)…