Differentially Private Fine-tuning of Language Models

Da Yu, Saurabh Naik, Arturs Backurs +9

We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-scale pre-trained language models, which achieve the state-of-the-art privacy versus…