2 papers
cs.DC2025
Serving Large Language Models on Huawei CloudMatrix384
Pengfei Zuo, Huimin Lin, Junbo Deng +43
The rapid evolution of large language models (LLMs), driven by growing parameter scales, adoption of mixture-of-experts (MoE) architectures, and expanding context lengths, imposes…
cs.AR2025
UB-Mesh: a Hierarchically Localized nD-FullMesh Datacenter Network Architecture
Heng Liao, Bingyang Liu, Xianping Chen +31
As the Large-scale Language Models (LLMs) continue to scale, the requisite computational power and bandwidth escalate. To address this, we introduce UB-Mesh, a novel AI datacenter…