Functional Mechanism: Regression Analysis under Differential Privacy

Abstract

ε-differential privacy is the state-of-the-art model for releasing sensitive information while protecting privacy. Numerous methods have been proposed to enforce epsilon-differential privacy in various analytical tasks, e.g., regression analysis. Existing solutions for regression analysis, however, are either limited to non-standard types of regression or unable to produce accurate regression results. Motivated by this, we propose the Functional Mechanism, a differentially private method designed for a large class of optimization-based analyses. The main idea is to enforce epsilon-differential privacy by perturbing the objective function of the optimization problem, rather than its results. As case studies, we apply the functional mechanism to address two most widely used regression models, namely, linear regression and logistic regression. Both theoretical analysis and thorough experimental evaluations show that the functional mechanism is highly effective and efficient, and it significantly outperforms existing solutions.

VLDB2012

References in corpus (1)

• Differentially Private Publication of Sparse Data

Cited by in corpus (17)

• Understanding Membership Inferences on Well-Generalized Learning Models
• How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy
• AutoGAN-based Dimension Reduction for Privacy Preservation
• Differential Privacy and Fairness in Decisions and Learning Tasks: A Survey
• Not one but many Tradeoffs: Privacy Vs. Utility in Differentially Private Machine Learning
• Sampling Attacks: Amplification of Membership Inference Attacks by Repeated Queries
• A Differentially Private Framework for Deep Learning with Convexified Loss Functions
• Weighted Distributed Differential Privacy ERM: Convex and Non-convex
• Deep Learning in Information Security
• Differentially private significance tests for regression coefficients
• On the Differential Privacy of Bayesian Inference
• Robustness Threats of Differential Privacy
• Privacy-Preserving Kickstarting Deep Reinforcement Learning with Privacy-Aware Learners
• On the Privacy Risks of Deploying Recurrent Neural Networks in Machine Learning Models
• Quantifying Membership Privacy via Information Leakage
• Improving Utility of Differentially Private Mechanisms through Cryptography-based Technologies: a Survey
• Optimizing Batch Linear Queries under Exact and Approximate Differential Privacy