Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
CascadeEP: Asynchronous Expert Execution for MoE Prefill under Attention Imbalance
Jin Qin, Tiancheng Hu, Shiyan Wang +12
Mixture-of-experts (MoE) serving commonly deploys data and expert parallelism (DEP): attention replicas run distinct request batches while routed experts are sharded across an expe…
cs.DC2026
Tessera: Unlocking Heterogeneous GPUs through Kernel-Granularity Disaggregation
Tiancheng Hu, Jin Qin, Zheng Wang +10
Disaggregation maps parts of an AI workload to different types of GPUs, offering a path to utilize modern heterogeneous GPU clusters. However, existing solutions operate at a coars…
cs.DC2025
KVSwap: Disk-aware KV Cache Offloading for Long-Context On-device Inference
Huawei Zhang, Chunwei Xia, Zheng Wang
Language models (LMs) underpin emerging mobile and embedded AI applications like meeting and video summarization and document analysis, which often require processing multiple long…