Pre-Pruning and Gradient-Dropping Improve Differentially Private Image Classification

Kamil Adamczewski, Yingchen He, Mijung Park

Scalability is a significant challenge when it comes to applying differential privacy to training deep neural networks. The commonly used DP-SGD algorithm struggles to maintain a h…