8 citations · 28 across the 29 of their papers we have counts for
8 papers · 2 filters
PSL-RGHA: Parallel Split Learning with Reference Gradient Half-Space Alignment for Mitigating Gradient Divergence
Han Li, Zheng Lin, Miao Yang +9
The escalating complexity of deep neural networks hinders the deployment of federated learning (FL) on resource-constrained devices, especially for multimedia applications such as…
Redundancy Meets Synergy: Dependency-aware Expert Selection for MoE via Submodular Optimization
Zheng Lin, Shaoke Fang, Yuxin Zhang +6
While Mixture-of-Experts (MoE) models effectively scale model capacity through sparse activation, their deployment is often bottlenecked by prohibitive memory requirements. Extract…
Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts
Yijun Lu, Zihan Fang, Pengpeng Qiao +6
The continuous scaling of large language models (LLMs) incurs prohibitive computational costs, making Mixture-of-Experts (MoE) a scalable alternative for efficient fine-tuning via…
SL-FAC: A Communication-Efficient Split Learning Framework with Frequency-Aware Compression
Zehang Lin, Miao Yang, Haihan Zhu +9
The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by…
Exploiting Adaptive Channel Pruning for Communication-Efficient Split Learning
Jialei Tan, Zheng Lin, Xiangming Cai +4
Split learning (SL) transfers most of the training workload to the server, which alleviates computational burden on client devices. However, the transmission of intermediate featur…
GAPSL: A Gradient-Aligned Parallel Split Learning over Data-Heterogeneous Edge Computing Systems
Zheng Lin, Ons Aouedi, Zihan Fang +4
The increasing complexity of neural networks poses significant challenges for democratizing federated learning (FL) on resource-constrained edge devices. Parallel split learning (P…
Conflict-Aware Client Selection for Multi-Server Federated Learning
Mingwei Hong, Zheng Lin, Zehang Lin +7
Federated learning (FL) has emerged as a promising distributed machine learning (ML) that enables collaborative model training across clients without exposing raw data, thereby pre…
HFedMoE: Resource-aware Heterogeneous Federated Learning with Mixture-of-Experts
Zihan Fang, Zheng Lin, Senkang Hu +5
While federated learning (FL) enables fine-tuning of large language models (LLMs) without compromising data privacy, the substantial size of an LLM renders on-device training impra…