AiFlow: Token-Native Reactive Orchestration with Bounded Backpressure for Streaming LLM Applications

Qunhui Zhang

Large language model (LLM) applications increasingly operate as streaming workflows combining retrieval, tool calls, safety filters, and multi-agent coordination. Although contempo…