Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Analytical Provisioning for Attention-FFN Disaggregated LLM Serving under Stochastic Workloads
Chendong Song, Meixuan Wang, Hang Zhou +5
Attentio-FFN disaggregation (AFD) is an emerging architecture for LLM decoding that separates state-heavy, KV-cache-dominated Attention computation from stateless, compute-intensiv…
cs.LG2025
Adaptively Robust LLM Inference Optimization under Prediction Uncertainty
Zixi Chen, Yinyu Ye, Zijie Zhou
We study the problem of optimizing Large Language Model (LLM) inference scheduling to minimize total latency. LLM inference is an online and multi-task service process and also hea…