SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

Yihui Zhang, Tianyu Wo, Jinghao Wang +7

As LLM agents increasingly rely on the Model Context Protocol (MCP) to invoke isolated external sandboxes, disaggregated sandbox deployment introduces a fundamental tension between…