FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models

Guohao Yang, Tongle Wu, Yuanxiong Guo +2

Fine-tuning is essential to adapt general-purpose large language models (LLMs) to domain-specific tasks. As a privacy-preserving framework to leverage decentralized data for collab…