6 papers · 1 filter
Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts
Yijun Lu, Zihan Fang, Pengpeng Qiao +6
The continuous scaling of large language models (LLMs) incurs prohibitive computational costs, making Mixture-of-Experts (MoE) a scalable alternative for efficient fine-tuning via…
TIC-GRPO: Provable and Efficient Optimization for Reinforcement Learning from Human Feedback
Lei Pang, Jun Luo, Ruinan Jin
Group Relative Policy Optimization (GRPO), recently introduced by DeepSeek, is a critic-free reinforcement learning algorithm for fine-tuning large language models. GRPO replaces t…
LLM-Driven Stationarity-Aware Expert Demonstrations for Multi-Agent Reinforcement Learning in Mobile Systems
Tianyang Duan, Zongyuan Zhang, Zheng Lin +10
Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge de…
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
Zheng Lin, Yuxin Zhang, Zhe Chen +6
Recently, large language models (LLMs) have achieved remarkable breakthroughs, revolutionizing the natural language processing domain and beyond. Due to immense parameter sizes, fi…
Hierarchical Split Federated Learning: Convergence Analysis and System Optimization
Zheng Lin, Wei Wei, Zhe Chen +4
As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated le…
LEO-Split: A Semi-Supervised Split Learning Framework over LEO Satellite Networks
Zheng Lin, Yuxin Zhang, Zhe Chen +5
Recently, the increasing deployment of LEO satellite systems has enabled various space analytics (e.g., crop and climate monitoring), which heavily relies on the advancements in de…