Fine-Tuning Language Models with Differential Privacy through Adaptive Noise Allocation

Xianzhi Li, Ran Zmigrod, Zhiqiang Ma +2

Language models are capable of memorizing detailed patterns and information, leading to a double-edged effect: they achieve impressive modeling performance on downstream tasks with…