4 papers
FedMABA: Towards Fair Federated Learning through Multi-Armed Bandits Allocation
Zhichao Wang, Lin Wang, Yongxin Guo +2
The increasing concern for data privacy has driven the rapid development of federated learning (FL), a privacy-preserving collaborative paradigm. However, the statistical heterogen…
Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent
Lin Wang, Zhichao Wang, Xiaoying Tang
The advent of large language models (LLMs) has revolutionized the deep learning paradigm, yielding impressive results across a wide array of tasks. However, the pre-training or fin…
Smart Sampling: Helping from Friendly Neighbors for Decentralized Federated Learning
Lin Wang, Yang Chen, Yongxin Guo +1
Federated Learning (FL) is gaining widespread interest for its ability to share knowledge while preserving privacy and reducing communication costs. Unlike Centralized FL, Decentra…
Client2Vec: Improving Federated Learning by Distribution Shifts Aware Client Indexing
Yongxin Guo, Lin Wang, Xiaoying Tang +1
Federated Learning (FL) is a privacy-preserving distributed machine learning paradigm. Nonetheless, the substantial distribution shifts among clients pose a considerable challenge…