2 papers
cs.DC2026
FastEEP: Fast Intra-Instance Elastic Scaling for Expert-Parallel MoE Serving
Yunfei Feng, Jingkai He, Shiqi Liu +3
Large-scale expert parallelism (EP) has become the standard deployment configuration for Mixture-of-Experts (MoE) models in production. Meanwhile, the highly dynamic nature of LLM…
cs.OS2026
DeltaBox: Millisecond-Scale Sandbox Checkpoint and Rollback for Stateful AI Agents
Yunpeng Dong, Jingkai He, Shiqi Liu +7
Emerging LLM-powered AI agent workloads, such as test-time tree search and reinforcement learning (RL), require high-frequency state exploration, relying on rapid checkpoint/restor…