35 citations · 36 across the 5 of their papers we have counts for
4 papers · 1 filter
Beyond Parameter Aggregation: Semantic Consensus for Federated Fine-Tuning of LLMs
Amr Abourayya, Jens Kleesiek, Michael Kamp
Federated fine-tuning of large language models is commonly formulated as a parameter aggregation problem. However, even parameter-efficient methods require transmitting large colle…
Whom to Trust? Adaptive Collaboration in Personalized Federated Learning
Amr Abourayya, Jens Kleesiek, Bharat Rao +1
Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their prediction…
Little is Enough: Boosting Privacy by Sharing Only Hard Labels in Federated Semi-Supervised Learning
Amr Abourayya, Jens Kleesiek, Kanishka Rao +4
In many critical applications, sensitive data is inherently distributed and cannot be centralized due to privacy concerns. A wide range of federated learning approaches have been p…
FAM: Relative Flatness Aware Minimization
Linara Adilova, Amr Abourayya, Jianning Li +5
Flatness of the loss curve around a model at hand has been shown to empirically correlate with its generalization ability. Optimizing for flatness has been proposed as early as 199…