MIRA: A Method of Federated MultI-Task Learning for LaRge LAnguage Models

Ahmed Elbakary, Chaouki Ben Issaid, Tamer ElBatt +2

In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of ea…