47 citations · 49 across the 3 of their papers we have counts for
3 papers
cs.LG2023★ 1 cited
Selective Pre-training for Private Fine-tuning
Da Yu, Sivakanth Gopi, Janardhan Kulkarni +5
Text prediction models, when used in applications like email clients or word processors, must protect user data privacy and adhere to model size constraints. These constraints are…
cs.CL2022★ 1 cited
Planting and Mitigating Memorized Content in Predictive-Text Language Models
C. M. Downey, Wei Dai, Huseyin A. Inan +3
Language models are widely deployed to provide automatic text completion services in user products. However, recent research has revealed that language models (especially large one…
cs.LG2021★ 47 cited
Differentially Private Fine-tuning of Language Models
Da Yu, Saurabh Naik, Arturs Backurs +9
We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-scale pre-trained language models, which achieve the state-of-the-art privacy versus…