2 papers
cs.DC2026
A Universal Load Balancing Principle and Its Application to Large Language Model Serving
Zixi Chen, Tianci Bu, Chendong Song +3
Over 40% of computational power in Large Language Model (LLM) serving systems can be systematically wasted - not from hardware limits, but from load imbalance in barrier-synchroniz…
cs.LG2025
Adaptively Robust LLM Inference Optimization under Prediction Uncertainty
Zixi Chen, Yinyu Ye, Zijie Zhou
We study the problem of optimizing Large Language Model (LLM) inference scheduling to minimize total latency. LLM inference is an online and multi-task service process and also hea…