Weights Shuffling for Improving DPSGD in Transformer-based Models

Jungang Yang, Zhe Ji, Liyao Xiang

Differential Privacy (DP) mechanisms, especially in high-dimensional settings, often face the challenge of maintaining privacy without compromising the data utility. This work intr…