DP-FP: Differentially Private Forward Propagation for Large Models

Jian Du, Haitao Mi

When applied to large-scale learning problems, the conventional wisdom on privacy-preserving deep learning, known as Differential Private Stochastic Gradient Descent (DP-SGD), has…