Privacy-preserving Non-negative Matrix Factorization with Outliers
arXiv:2211.01451 · doi:10.1145/3632961
Abstract
Non-negative matrix factorization is a popular unsupervised machine learning algorithm for extracting meaningful features from data which are inherently non-negative. However, such data sets may often contain privacy-sensitive user data, and therefore, we may need to take necessary steps to ensure the privacy of the users while analyzing the data. In this work, we focus on developing a Non-negative matrix factorization algorithm in the privacy-preserving framework. More specifically, we propose a novel privacy-preserving algorithm for non-negative matrix factorisation capable of operating on private data, while achieving results comparable to those of the non-private algorithm. We design the framework such that one has the control to select the degree of privacy grantee based on the utility gap. We show our proposed framework's performance in six real data sets. The experimental results show that our proposed method can achieve very close performance with the non-private algorithm under some parameter regime, while ensuring strict privacy.
arXiv comment15 pages, 11 figures; additional explanations (in blue colours)
References in corpus (10)
- Deep Learning with Differential Privacy
- Renyi Differential Privacy
- Differentially Private Empirical Risk Minimization
- An Alternating Direction Algorithm for Matrix Completion with Nonnegative Factors
- Nonlinear hyperspectral unmixing with robust nonnegative matrix factorization
- Differentially Private Learning with Adaptive Clipping
- Online Nonnegative Matrix Factorization with Outliers
- Accuracy First: Selecting a Differential Privacy Level for Accuracy-Constrained ERM
- Differentially Private Empirical Risk Minimization Revisited: Faster and More General
- Differentially Private Filtering