Improving Differentially Private SGD via Randomly Sparsified Gradients

Junyi Zhu, Matthew B. Blaschko

Differentially private stochastic gradient descent (DP-SGD) has been widely adopted in deep learning to provide rigorously defined privacy, which requires gradient clipping to boun…