Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
SAC: Disaggregated KV Cache System for Sparse Attention LLMs with CXL
Ruiyang Ma, Teng Ma, Junru Li +7
The scaling of LLMs toward long-context inference has shifted the primary serving system bottleneck from computation to memory capacity. Traditional solutions for dense attention m…
cs.DC2026
ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL
Wei Gao, Yuheng Zhao, Dilxat Muhtar +13
Agentic reinforcement learning (RL) is reshaping LLM post-training, but end-to-end training time is dominated by compute-intensive, multi-turn rollouts whose resource demand varies…
cs.DC2026
Surviving Partial Rank Failures in Wide Expert-Parallel MoE Inference
Xun Sun, Shaoyuan Chen, Pingchuan Ma +18
Mixture-of-Experts (MoE) serving relies on wide expert parallelism (EP) to aggregate the memory capacity and bandwidth of many GPUs within one inference instance. This efficiency c…