A Split-and-Privatize Framework for Large Language Model Fine-Tuning

Xicong Shen, Yang Liu, Huiqi Liu +6

Fine-tuning is a prominent technique to adapt a pre-trained language model to downstream scenarios. In parameter-efficient fine-tuning, only a small subset of modules are trained o…