1 citations · 1 across the 4 of their papers we have counts for
4 papers
HALO: Semantic-Aware Distributed LLM Inference in Lossy Edge Network
Peirong Zheng, Wenchao Xu, Haozhao Wang +2
The deployment of large language models' (LLMs) inference at the edge can facilitate prompt service responsiveness while protecting user privacy. However, it is critically challeng…
Deploying Foundation Model Powered Agent Services: A Survey
Wenchao Xu, Jinyu Chen, Peirong Zheng +8
Foundation model (FM) powered agent services are regarded as a promising solution to develop intelligent and personalized applications for advancing toward Artificial General Intel…
OTAS: An Elastic Transformer Serving System via Token Adaptation
Jinyu Chen, Wenchao Xu, Zicong Hong +4
Transformer model empowered architectures have become a pillar of cloud services that keeps reshaping our society. However, the dynamic query loads and heterogeneous user requireme…
Overcome Modal Bias in Multi-modal Federated Learning via Balanced Modality Selection
Yunfeng Fan, Wenchao Xu, Haozhao Wang +3
Selecting proper clients to participate in each federated learning (FL) round is critical to effectively harness a broad range of distributed data. Existing client selection method…