1 citations · 2 across the 5 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2025
Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges
Senyao Li, Haozhao Wang, Wenchao Xu +6
As large language models (LLMs) evolve, deploying them solely in the cloud or compressing them for edge devices has become inadequate due to concerns about latency, privacy, cost,…
cs.DC2024
OTAS: An Elastic Transformer Serving System via Token Adaptation
Jinyu Chen, Wenchao Xu, Zicong Hong +4
Transformer model empowered architectures have become a pillar of cloud services that keeps reshaping our society. However, the dynamic query loads and heterogeneous user requireme…