Improved Differentially Private Decentralized Source Separation for fMRI Data

Abstract

Blind source separation algorithms such as independent component analysis (ICA) are widely used in the analysis of neuroimaging data. In order to leverage larger sample sizes, different data holders/sites may wish to collaboratively learn feature representations. However, such datasets are often privacy-sensitive, precluding centralized analyses that pool the data at a single site. In this work, we propose a differentially private algorithm for performing ICA in a decentralized data setting. Conventional approaches to decentralized differentially private algorithms may introduce too much noise due to the typically small sample sizes at each site. We propose a novel protocol that uses correlated noise to remedy this problem. We show that our algorithm outperforms existing approaches on synthetic and real neuroimaging datasets and demonstrate that it can sometimes reach the same level of utility as the corresponding non-private algorithm. This indicates that it is possible to have meaningful utility while preserving privacy.

arXiv comment\c{opyright} 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. arXiv admin note: text overlap with arXiv:1904.10059

References in corpus (16)

• Deep Learning with Differential Privacy
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Renyi Differential Privacy
• Differentially Private Distributed Constrained Optimization
• How To Break Anonymity of the Netflix Prize Dataset
• Differential Privacy and Machine Learning: a Survey and Review
• Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergences
• Quantifying Differential Privacy under Temporal Correlations
• CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learning
• Distributed Differentially-Private Algorithms for Matrix and Tensor Factorization
• Encode, Shuffle, Analyze Privacy Revisited: Formalizations and Empirical Evaluation
• Differentially Private Bayesian Learning on Distributed Data
• Accuracy First: Selecting a Differential Privacy Level for Accuracy-Constrained ERM
• Optimal Algorithms for Distributed Optimization
• Distributed Differentially Private Computation of Functions with Correlated Noise
• Temporal and Spatial Independent Component Analysis for fMRI data sets embedded in a R package