Pre-trained Perceptual Features Improve Differentially Private Image Generation

Fredrik Harder, Milad Jalali Asadabadi, Danica J. Sutherland +1

Training even moderately-sized generative models with differentially-private stochastic gradient descent (DP-SGD) is difficult: the required level of noise for reasonable levels of…