Low-Parameter Federated Learning with Large Language Models

Jingang Jiang, Xiangyang Liu, Chenyou Fan

We study few-shot Natural Language Understanding (NLU) tasks with Large Language Models (LLMs) in federated learning (FL) scenarios. It is a challenging task due to limited labeled…