12 citations · 62 across the 39 of their papers we have counts for
5 papers · 1 filter
Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges
Senyao Li, Haozhao Wang, Wenchao Xu +6
As large language models (LLMs) evolve, deploying them solely in the cloud or compressing them for edge devices has become inadequate due to concerns about latency, privacy, cost,…
Deploying Foundation Model Powered Agent Services: A Survey
Wenchao Xu, Jinyu Chen, Peirong Zheng +8
Foundation model (FM) powered agent services are regarded as a promising solution to develop intelligent and personalized applications for advancing toward Artificial General Intel…
OTAS: An Elastic Transformer Serving System via Token Adaptation
Jinyu Chen, Wenchao Xu, Zicong Hong +4
Transformer model empowered architectures have become a pillar of cloud services that keeps reshaping our society. However, the dynamic query loads and heterogeneous user requireme…
Mobility and Cost Aware Inference Accelerating Algorithm for Edge Intelligence
Xin Yuan, Ning Li, kang Wei +4
The edge intelligence (EI) has been widely applied recently. Spliting the model between device, edge server, and cloud can improve the performance of EI greatly. The model segmenta…
Layer-wised Model Aggregation for Personalized Federated Learning
Xiaosong Ma, Jie Zhang, Song Guo +1
Personalized Federated Learning (pFL) not only can capture the common priors from broad range of distributed data, but also support customized models for heterogeneous clients. Res…