Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
\k{appa}-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating
Jianghui Wang, Silong Yong, Francesco Orabona +3
Low-Rank Adaptation (LoRA) has become a widely adopted technique for efficient neural network fine-tuning, decomposing model updates into low-rank matrices. However, LoRA remains c…
cs.LG2024
Where is the Testbed for my Federated Learning Research?
Janez Božič, Amândio R. Faustino, Boris Radovič +2
Progressing beyond centralized AI is of paramount importance, yet, distributed AI solutions, in particular various federated learning (FL) algorithms, are often not comprehensively…
cs.LG2024
Decentralized Personalized Federated Learning
Salma Kharrat, Marco Canini, Samuel Horvath
This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides eac…