Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
MAPS: Memory-Aware Predictive Scheduling Framework for Large Language Model Serving
Tiancheng Zhang, Yulin Chen, Yunfeng Zhao +3
The surge of large language model (LLM) applications on personal devices imposes massive, bursty workloads on cloud serving infrastructure. While prefill-decode disaggregation impr…
cs.AI2026
FineServe: A Fine-Grained Dataset and Characterization of Global LLM Serving Workloads
Tiancheng Zhang, Shaoyuan Huang, Mingyuan Wang +3
Large language models (LLMs) are increasingly deployed as always-on online services, making efficient LLM serving a critical systems challenge. Achieving low latency and high throu…