Batch Query Processing and Optimization for Agentic Workflows

Junyi Shen, Noppanat Wadlom, Yao Lu

Large Language Models (LLMs) in agentic workflows combine multi-step reasoning, heterogeneous tool use, and collaboration across multiple specialized agents. Existing LLM serving e…