Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Redundancy Meets Synergy: Dependency-aware Expert Selection for MoE via Submodular Optimization
Zheng Lin, Shaoke Fang, Yuxin Zhang +6
While Mixture-of-Experts (MoE) models effectively scale model capacity through sparse activation, their deployment is often bottlenecked by prohibitive memory requirements. Extract…
cs.LG2026
Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts
Yijun Lu, Zihan Fang, Pengpeng Qiao +6
The continuous scaling of large language models (LLMs) incurs prohibitive computational costs, making Mixture-of-Experts (MoE) a scalable alternative for efficient fine-tuning via…
cs.LG2025
SL-ACC: A Communication-Efficient Split Learning Framework with Adaptive Channel-wise Compression
Zehang Lin, Zheng Lin, Miao Yang +7
The increasing complexity of neural networks poses a significant barrier to the deployment of distributed machine learning (ML) on resource-constrained devices, such as federated l…