DC-SGD: Differentially Private SGD with Dynamic Clipping through Gradient Norm Distribution Estimation

Chengkun Wei, Weixian Li, Chen Gong +1

Differentially Private Stochastic Gradient Descent (DP-SGD) is a widely adopted technique for privacy-preserving deep learning. A critical challenge in DP-SGD is selecting the opti…