Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Survey

Abstract

Differential Privacy has become a widely popular method for data protection in machine learning, especially since it allows formulating strict mathematical privacy guarantees. This survey provides an overview of the state-of-the-art of differentially private centralized deep learning, thorough analyses of recent advances and open problems, as well as a discussion of potential future developments in the field. Based on a systematic literature review, the following topics are addressed: auditing and evaluation methods for private models, improvements of privacy-utility trade-offs, protection against a broad range of threats and attacks, differentially private generative models, and emerging application domains.

35 pages, 2 figures

References in corpus (16)

• Explaining and Harnessing Adversarial Examples
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
• Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data
• More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
• Privacy Preserving Face Recognition Utilizing Differential Privacy
• Differential Private Knowledge Transfer for Privacy-Preserving Cross-Domain Recommendation
• A Critical Review on the Use (and Misuse) of Differential Privacy in Machine Learning
• Large Language Models Can Be Strong Differentially Private Learners
• Robust Anomaly Detection and Backdoor Attack Detection Via Differential Privacy
• Differentially Private Learning Needs Better Features (or Much More Data)
• Debugging Differential Privacy: A Case Study for Privacy Auditing
• Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
• An Empirical Analysis of Fairness Notions under Differential Privacy
• Differential Privacy Meets Neural Network Pruning
• Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe

Cited by in corpus (4)

• Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
• Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications
• PPFL-RDSN: Privacy-Preserving Federated Learning-based Residual Dense Spatial Networks for Encrypted Lossy Image Reconstruction
• DP-CDA: An Algorithm for Enhanced Privacy Preservation in Dataset Synthesis Through Randomized Mixing