Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models

Fei Wu, Jia Hu, Geyong Min +1

Pre-trained Language Models (PLMs) have demonstrated their superiority and versatility in modern Natural Language Processing (NLP), effectively adapting to various downstream tasks…