3 papers
cs.LG2026
-Agent: An Executable and Evolving Agent for Resource Management of Edge Generative Inference
Rui Bao, Yaping Sun, Zhiyong Chen +4
Edge deployments of generative inference increasingly face two practical realities: per-device per-model performance is often unknown at deployment time, and it is non-stationary d…
cs.IT2025
Dynamic Quality-Latency Aware Routing for LLM Inference in Wireless Edge-Device Networks
Rui Bao, Nan Xue, Yaping Sun +1
The integration of wireless communications and Large Language Models (LLMs) is poised to unlock ubiquitous intelligent services, yet deploying them in wireless edge-device collabor…
cs.IT2025
CSGO: Generalized Optimization for Cold Start in Wireless Collaborative Edge LLM Systems
Xuran Liu, Nan Xue, Rui Bao +5
While deploying large language models on edge devices promises low-latency and privacy-preserving AI services, it is hindered by limited device resources. Although pipeline paralle…