Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
SwarmX: Agentic Scheduling for Low-Latency Agentic Systems
Yeqi Huang, Yanwei Ye, Guomin Chen +8
Agentic AI applications compose multiple model calls and tool executions, creating new scheduling challenges for GPU-CPU clusters. Their inference time and model-call structure oft…
cs.DC2025
MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching
Tairan Xu, Leyang Xue, Zhan Lu +2
This paper presents MoE-Gen, a high-throughput MoE inference system optimized for single-GPU execution. Existing inference systems rely on model-based or continuous batching strate…