Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Accelerating Mixture-of-Expert Inference with Adaptive Expert Split Mechanism
Jiaming Yan, Jianchun Liu, Hongli Xu +1
Mixture-of-Experts (MoE) has emerged as a promising architecture for modern large language models (LLMs). However, massive parameters impose heavy GPU memory (i.e., VRAM) demands,…
cs.LG2025
Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
Shilong Wang, Jianchun Liu, Hongli Xu +2
Fine-tuning plays a crucial role in enabling pre-trained LLMs to evolve from general language comprehension to task-specific expertise. To preserve user data privacy, federated fin…
cs.LG2024
Caesar: A Low-deviation Compression Approach for Efficient Federated Learning
Jiaming Yan, Jianchun Liu, Hongli Xu +4
Compression is an efficient way to relieve the tremendous communication overhead of federated learning (FL) systems. However, for the existing works, the information loss under com…