Towards Building the Federated GPT: Federated Instruction Tuning

Jianyi Zhang, Saeed Vahidian, Martin Kuo +6

While "instruction-tuned" generative large language models (LLMs) have demonstrated an impressive ability to generalize to new tasks, the training phases heavily rely on large amou…