2 papers
cs.DC2026
Revealing the Challenges of Attention-FFN Disaggregation for Modern MoE Models and Hardware Systems
Guowei Liu, Hongming Li, Yaning Guo +5
Deploying large-scale MoE models presents challenges in memory capacity and bandwidth for expert activation. While Attention-FFN Disaggregation (AFD) has emerged as a potential arc…
cs.DC2025
Serving Large Language Models on Huawei CloudMatrix384
Pengfei Zuo, Huimin Lin, Junbo Deng +43
The rapid evolution of large language models (LLMs), driven by growing parameter scales, adoption of mixture-of-experts (MoE) architectures, and expanding context lengths, imposes…