2 papers
cs.LG2026
DeaMoE: Efficient MoE Structure for Fast Small-Batch Decoding
Zewen Jin, Shen Fu, Zeping Duan +8
Mixture-of-Experts (MoE) models have been widely adopted in real-time interactive applications such as coding assistants, real-time audio-video interaction systems. To meet the ext…
cs.DC2024
Hiding Communication Cost in Distributed LLM Training via Micro-batch Co-execution
Haiquan Wang, Chaoyi Ruan, Jia He +4
The growth of Large Language Models (LLMs) has necessitated large-scale distributed training. Highly optimized frameworks, however, still suffer significant losses in Model FLOPS u…