SmoothAgent: Efficient Long-Horizon LLM-Based Agent Serving with Lookahead Context Engineering

Zaifeng Pan, Qianxu Wang, Zhengding Hu +5

LLM-based agents execute multi-turn workflows with continuously growing contexts, where LLM calls are interleaved with tool invocations and environment feedback. To maintain model…