Privacy Regularization: Joint Privacy-Utility Optimization in Language Models

Fatemehsadat Mireshghallah, Huseyin A. Inan, Marcello Hasegawa +3

Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such…