activity
20232026
most citedEfficient Deployment of Large Language Models on Resource-constrained Devices

3 citations · 3 across the 8 of their papers we have counts for

collaborators

8 papers

cs.LG2026

ReLoRA: Knowledge-Reusing Adaptation for Fast Rollout of Evolving LLM Services

Yang Xu, Zihuai Xu, Hongli Xu +3

Large Language Models (LLMs) are increasingly deployed as continuously evolving services, where frequent base-model updates may invalidate previously deployed task-specific Low-Ran…

cs.DC2025

Cross-region Model Training with Communication-Computation Overlapping and Delay Compensation

Ying Zhu, Yang Xu, Hongli Xu +3

Training large language models (LLMs) requires massive computational resources, often necessitating the aggregation of geographically distributed data centers (\ie, cross-region tr…

cs.LG2025

A Novel Hat-Shaped Device-Cloud Collaborative Inference Framework for Large Language Models

Zuan Xie, Yang Xu, Hongli Xu +2

Recent advancements in large language models (LLMs) have catalyzed a substantial surge in demand for LLM services. While traditional cloud-based LLM services satisfy high-accuracy…

cs.LG2025

Lightweight and Post-Training Structured Pruning for On-Device Large Lanaguage Models

Zihuai Xu, Yang Xu, Hongli Xu +3

Considering the hardware-friendly characteristics and broad applicability, structured pruning has emerged as an efficient solution to reduce the resource demands of large language…

cs.LG2025★ 3 cited

Efficient Deployment of Large Language Models on Resource-constrained Devices

Zhiwei Yao, Yang Xu, Hongli Xu +2

Deploying Large Language Models (LLMs) on resource-constrained (or weak) devices presents significant challenges due to limited resources and heterogeneous data distribution. To ad…

cs.DC2024

ParallelSFL: A Novel Split Federated Learning Framework Tackling Heterogeneity Issues

Yunming Liao, Yang Xu, Hongli Xu +3

Mobile devices contribute more than half of the world's web traffic, providing massive and diverse data for powering various federated learning (FL) applications. In order to avoid…

cs.LG2024

An Efficient NAS-based Approach for Handling Imbalanced Datasets

Zhiwei Yao

Class imbalance is a common issue in real-world data distributions, negatively impacting the training of accurate classifiers. Traditional approaches to mitigate this problem fall…

cs.LG2023

MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulation

Yunming Liao, Yang Xu, Hongli Xu +3

Recently, federated learning (FL) has emerged as a popular technique for edge AI to mine valuable knowledge in edge computing (EC) systems. To mitigate the computing/communication…