2 papers
cs.DC2026
Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel
Hongyi Jin, Bohan Hou, Guanjie Wang +18
Modern GPU workloads, especially large language model (LLM) inference, suffer from kernel launch overheads and coarse synchronization that limit inter-kernel parallelism. Recent me…
cs.LG2026
Justitia: Fair and Efficient Scheduling of Task-parallel LLM Agents with Selective Pampering
Mingyan Yang, Guanjie Wang, Manqi Luo +6
LLM agents, which often comprise parallel inference tasks, are commonly adopted to solve real-world problems. When serving such task-parallel LLM agents in shared GPU servers, the…