2 papers
cs.DC2026
AceSpec: An Asymmetric Edge-Cloud Collaborative Framework for Communication-Efficient LLM Inference
Yida Zhang, Zhiyong Gao, Shuaibing Yue +2
Deploying Large Language Models (LLMs) on edge devices typically relies on model compression or split inference. However, compression degrades reasoning capabilities, while split i…
cs.DC2026
A Pipelined Collaborative Speculative Decoding Framework for Efficient Edge-Cloud LLM Inference
Yida Zhang, Zhiyong Gao, Shuaibing Yue +2
Recent advancements and widespread adoption of Large Language Models (LLMs) in both industry and academia have catalyzed significant demand for LLM serving. However, traditional cl…