Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
CoAgent: Concurrency Control for Multi-Agent Systems
Hongtao Lyu, Dingyan Zhang, Mingyu Wu +2
Multi-agent LLM systems -- coding agents, devops agents, document agents -- now routinely run several agents in parallel against the same git tree, Kubernetes cluster, or document.…
cs.DC2025
FairBatching: Fairness-Aware Batch Formation for LLM Inference
Hongtao Lyu, Boyue Liu, Mingyu Wu +1
Large language model (LLM) inference systems face a fundamental tension between minimizing Time-to-First-Token (TTFT) latency for new requests and maintaining a high, steady token…