A Policy-Driven Runtime Layer for Agentic LLM Serving

Rui Zhang, Chaeeun Kim, Liting Hu

Multi-agent LLM systems have become the dominant production workload, but the serving stack was not built for them. The agent framework above knows agent identities, role, schemas,…