Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping

Umut Şimşekli, Mert Gürbüzbalaban, Sinan Yıldırım +1

The injection of heavy-tailed noise into the iterates of stochastic gradient descent (SGD) has garnered growing interest in recent years due to its theoretical and empirical benefi…