Decoupling Readiness from Release for Tail-Aware Scheduling of Agentic LLM Workflows

Bochao Feng, Jianjiang Li, Haojie Wang +4

Agentic LLM workflows consist of sequences of model turns interleaved with tool interactions, so their end-to-end completion time depends not only on inference speed but also on wh…