On the Performance of Differentially Private Optimization with Heavy-Tail Class Imbalance

Qiaoyue Tang, Alain Zhiyanov, Mathias Lécuyer

In this work, we analyze the optimization behaviour of common private learning optimization algorithms under heavy-tail class imbalanced distribution. We show that, in a stylized m…