Aragog: Just-in-Time Model Routing for Scalable Serving of Agentic Workflows

Yinwei Dai, Zhuofu Chen, Anand Iyer +1

Agentic workflows have emerged as a powerful paradigm for solving complex, multi-stage tasks, but serving them at scale is computationally expensive given the many LLM inferences t…