Learning Agent Execution for KV-Cache Management in Agentic Serving

Rui Zhang, Chaeeun Kim, Shaoting Feng +6

Multi-agent LLM systems have emerged as an important deployment paradigm for AI services, where each user request is decomposed into a sequence of specialized agents. Across these…