Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA

Xiaoyu Wang, Xiaotian Li, Zhixiang Zhou +2

Decentralized federated learning (DFL), a serverless variant of federated learning, poses unique challenges for parameter-efficient fine-tuning due to the factorized structure of l…