FraQ: Efficient Coordinate-Space Recompression for Federated Low-Rank Adaptation

Shenghui Li, Thiemo Voigt

Federated fine-tuning with Low-Rank Adaptation (LoRA) enables efficient collaborative adaptation of Large Language Models (LLMs) without centralizing private data. However, LoRA's…