NanoBatch Privacy: Enabling fast Differentially Private learning on the IPU

Edward H. Lee, Mario Michael Krell, Alexander Tsyplikhin +3

Differentially private SGD (DPSGD) has recently shown promise in deep learning. However, compared to non-private SGD, the DPSGD algorithm places computational overheads that can un…