8 citations · 28 across the 29 of their papers we have counts for
18 papers · 1 filter
PSL-RGHA: Parallel Split Learning with Reference Gradient Half-Space Alignment for Mitigating Gradient Divergence
Han Li, Zheng Lin, Miao Yang +9
The escalating complexity of deep neural networks hinders the deployment of federated learning (FL) on resource-constrained devices, especially for multimedia applications such as…
Redundancy Meets Synergy: Dependency-aware Expert Selection for MoE via Submodular Optimization
Zheng Lin, Shaoke Fang, Yuxin Zhang +6
While Mixture-of-Experts (MoE) models effectively scale model capacity through sparse activation, their deployment is often bottlenecked by prohibitive memory requirements. Extract…
Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts
Yijun Lu, Zihan Fang, Pengpeng Qiao +6
The continuous scaling of large language models (LLMs) incurs prohibitive computational costs, making Mixture-of-Experts (MoE) a scalable alternative for efficient fine-tuning via…
SL-FAC: A Communication-Efficient Split Learning Framework with Frequency-Aware Compression
Zehang Lin, Miao Yang, Haihan Zhu +9
The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by…
Exploiting Adaptive Channel Pruning for Communication-Efficient Split Learning
Jialei Tan, Zheng Lin, Xiangming Cai +4
Split learning (SL) transfers most of the training workload to the server, which alleviates computational burden on client devices. However, the transmission of intermediate featur…
GAPSL: A Gradient-Aligned Parallel Split Learning over Data-Heterogeneous Edge Computing Systems
Zheng Lin, Ons Aouedi, Zihan Fang +4
The increasing complexity of neural networks poses significant challenges for democratizing federated learning (FL) on resource-constrained edge devices. Parallel split learning (P…
Conflict-Aware Client Selection for Multi-Server Federated Learning
Mingwei Hong, Zheng Lin, Zehang Lin +7
Federated learning (FL) has emerged as a promising distributed machine learning (ML) that enables collaborative model training across clients without exposing raw data, thereby pre…
HFedMoE: Resource-aware Heterogeneous Federated Learning with Mixture-of-Experts
Zihan Fang, Zheng Lin, Senkang Hu +5
While federated learning (FL) enables fine-tuning of large language models (LLMs) without compromising data privacy, the substantial size of an LLM renders on-device training impra…
LLM-Driven Stationarity-Aware Expert Demonstrations for Multi-Agent Reinforcement Learning in Mobile Systems
Tianyang Duan, Zongyuan Zhang, Zheng Lin +10
Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge de…
Sample Efficient Experience Replay in Non-stationary Environments
Tianyang Duan, Zongyuan Zhang, Songxiao Guo +8
Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (E…
SL-ACC: A Communication-Efficient Split Learning Framework with Adaptive Channel-wise Compression
Zehang Lin, Zheng Lin, Miao Yang +7
The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated l…
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
Zheng Lin, Yuxin Zhang, Zhe Chen +6
Recently, large language models (LLMs) have achieved remarkable breakthroughs, revolutionizing the natural language processing domain and beyond. Due to immense parameter sizes, fi…
Robust Deep Reinforcement Learning in Robotics via Adaptive Gradient-Masked Adversarial Attacks
Zongyuan Zhang, Tianyang Duan, Zheng Lin +8
Deep reinforcement learning (DRL) has emerged as a promising approach for robotic control, but its realworld deployment remains challenging due to its vulnerability to environmenta…
State-Aware Perturbation Optimization for Robust Deep Reinforcement Learning
Zongyuan Zhang, Tianyang Duan, Zheng Lin +7
Recently, deep reinforcement learning (DRL) has emerged as a promising approach for robotic control. However, the deployment of DRL in real-world robots is hindered by its sensitiv…
LEO-Split: A Semi-Supervised Split Learning Framework over LEO Satellite Networks
Zheng Lin, Yuxin Zhang, Zhe Chen +5
Recently, the increasing deployment of LEO satellite systems has enabled various space analytics (e.g., crop and climate monitoring), which heavily relies on the advancements in de…
SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
Zheng Lin, Xuanjie Hu, Yuxin Zhang +6
The scalability of large language models (LLMs) in handling high-complexity models and large-scale datasets has led to tremendous successes in pivotal domains. While there is an ur…
Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
Zihan Fang, Zheng Lin, Zhe Chen +3
Recently, there has been a surge in the development of advanced intelligent generative content (AIGC), especially large language models (LLMs). However, for many downstream tasks,…
FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networks
Zheng Lin, Zhe Chen, Zihan Fang +3
Recently, a large number of Low Earth Orbit (LEO) satellites have been launched and deployed successfully in space by commercial companies, such as SpaceX. Due to multimodal sensor…