SARA: SLO-Aware Resource Allocation for Disaggregated Agentic LLM Services

Shicong Liu, Xianghao Yu, Zhen Gao +1

Recent advances in large language models (LLMs) are driving the emergence of multi-modal and agentic services for mobile users through cloud and edge infrastructures, where long-co…