Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
ElastiCo: Elastic Configuration and Interference-Aware Orchestration for GPU Clusters
Jinghao Wang, Yihang Zhou, Xiaoyang Sun +5
Modern GPU clusters must simultaneously serve deep learning training and offline large language model inference workloads, yet existing schedulers treat these as isolated resource…
cs.DC2026
SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving
Yihui Zhang, Tianyu Wo, Jinghao Wang +7
As LLM agents increasingly rely on the Model Context Protocol (MCP) to invoke isolated external sandboxes, disaggregated sandbox deployment introduces a fundamental tension between…