2 papers
cs.AR2026
Trillion-Parameter MoE in a Box: Decoupling Memory Provisioning with High-Bandwidth Flash
Pengfei Xia, Tuo Hao, Shengwei Li +5
An MoE appliance for trillion-parameter models at low concurrency must host terabytes of weights on one node and serve prefill and decode with fixed resources. Combining operator a…
cs.DC2026
Beyond Uniform Experts: Cost-Aware Expert Execution for Efficient Multi-Device MoE Inference
Hui Zang, Pengfei Xia, Hong Liu +5
Mixture-of-Experts (MoE) architectures enable language models to achieve unprecedented scale via sparse activation. However, their inference performance is often limited by data mo…