Towards Distributed Privacy-Preserving Prediction

Abstract

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these problems, we demonstrate a generally applicable Distributed Privacy-Preserving Prediction (DPPP) framework, in which instead of sharing more sensitive data or model parameters, an untrusted aggregator combines only multiple models' predictions under provable privacy guarantee. Our framework integrates two main techniques to guarantee individual privacy. First, we introduce the improved Binomial Mechanism and Discrete Gaussian Mechanism to achieve distributed differential privacy. Second, we utilize homomorphic encryption to ensure that the aggregator learns nothing but the noisy aggregated prediction. Experimental results demonstrate that our framework has comparable performance to the non-private frameworks and delivers better results than the local differentially private framework and standalone framework.

arXiv commentTo appear at SMC'20

References in corpus (6)

• Deep Learning with Differential Privacy
• Learning Differentially Private Recurrent Language Models
• Scalable Private Learning with PATE
• Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data
• Improving the Gaussian Mechanism for Differential Privacy: Analytical Calibration and Optimal Denoising
• Local Differential Privacy and Its Applications: A Comprehensive Survey

Cited by in corpus (1)

• Local Differential Privacy and Its Applications: A Comprehensive Survey