Privacy Loss of Noisy Stochastic Gradient Descent Might Converge Even for Non-Convex Losses

Shahab Asoodeh, Mario Diaz

The Noisy-SGD algorithm is widely used for privately training machine learning models. Traditional privacy analyses of this algorithm assume that the internal state is publicly rev…