2 papers
cs.LG2025
Scalable and Resource-Efficient Second-Order Federated Learning via Over-the-Air Aggregation
Abdulmomen Ghalkha, Chaouki Ben Issaid, Mehdi Bennis
Second-order federated learning (FL) algorithms offer faster convergence than their first-order counterparts by leveraging curvature information. However, they are hindered by high…
cs.LG2024
MIRA: A Method of Federated MultI-Task Learning for LaRge LAnguage Models
Ahmed Elbakary, Chaouki Ben Issaid, Tamer ElBatt +2
In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of ea…