8 citations · 31 across the 7 of their papers we have counts for
12 papers
Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
Xinyu Tang, Richard Shin, Huseyin A. Inan +6
We study the problem of in-context learning (ICL) with large language models (LLMs) on private datasets. This scenario poses privacy risks, as LLMs may leak or regurgitate the priv…
Differentially Private Model Compression
Fatemehsadat Mireshghallah, Arturs Backurs, Huseyin A Inan +2
Recent papers have shown that large pre-trained language models (LLMs) such as BERT, GPT-2 can be fine-tuned on private data to achieve performance comparable to non-private models…
What Does it Mean for a Language Model to Preserve Privacy?
Hannah Brown, Katherine Lee, Fatemehsadat Mireshghallah +2
Natural language reflects our private lives and identities, making its privacy concerns as broad as those of real life. Language models lack the ability to understand the context a…
When Differential Privacy Meets Interpretability: A Case Study
Rakshit Naidu, Aman Priyanshu, Aadith Kumar +3
Given the increase in the use of personal data for training Deep Neural Networks (DNNs) in tasks such as medical imaging and diagnosis, differentially private training of DNNs is s…
DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?
Archit Uniyal, Rakshit Naidu, Sasikanth Kotti +4
Recent advances in differentially private deep learning have demonstrated that application of differential privacy, specifically the DP-SGD algorithm, has a disparate impact on dif…
Privacy Regularization: Joint Privacy-Utility Optimization in Language Models
Fatemehsadat Mireshghallah, Huseyin A. Inan, Marcello Hasegawa +3
Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such…