FIBER: A Differentially Private Optimizer with Filter-Aware Innovation Bias Correction

Duc Dm, Thao Do, Minh Son Hoang +3

Differentially private (DP) training protects individual examples by adding noise to gradients, but the injected noise interacts nontrivially with adaptive optimizers. Recent DP me…