Latency-Aware Orchestration for Multi-Agent LLM Workflows on Heterogeneous GPUs

Jinghao Wang, Yifeng Zhang, Xiao Zhou +7

Concurrent multi-agent workflows expose future dependencies and serving-state requirements while running on heterogeneous GPU pools with time-varying load, model residency, and res…