Privacy-preserving Federated Bayesian Learning of a Generative Model for Imbalanced Classification of Clinical Data

Abstract

In clinical research, the lack of events of interest often necessitates imbalanced learning. One approach to resolve this obstacle is data integration or sharing, but due to privacy concerns neither is practical. Therefore, there is an increasing demand for a platform on which an analysis can be performed in a federated environment while maintaining privacy. However, it is quite challenging to develop a federated learning algorithm that can address both privacy-preserving and class imbalanced issues. In this study, we introduce a federated generative model learning platform for generating samples in a data-distributed environment while preserving privacy. We specifically propose approximate Bayesian computation-based Gaussian Mixture Model called 'Federated ABC-GMM', which can oversample data in a minor class by estimating the posterior distribution of model parameters across institutions in a privacy-preserving manner. PhysioNet2012, a dataset for prediction of mortality of patients in an Intensive Care Unit (ICU), was used to verify the performance of the proposed method. Experimental results show that our method boosts classification performance in terms of F1 score up to nearly an ideal situation. It is believed that the proposed method can be a novel alternative to solving class imbalance problems.

arXiv comment10 pages, 3 figures, 3 tables

References in corpus (21)

• Adam: A Method for Stochastic Optimization
• SMOTE: Synthetic Minority Over-sampling Technique
• Deep Learning with Differential Privacy
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• An overview of gradient descent optimization algorithms
• Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
• NIPS 2016 Tutorial: Generative Adversarial Networks
• Understanding deep learning requires rethinking generalization
• The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
• Differentially Private Federated Learning: A Client Level Perspective
• A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
• Fair Resource Allocation in Federated Learning
• Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
• Federated Tensor Factorization for Computational Phenotyping
• ABC-CDE: Towards Approximate Bayesian Computation with Complex High-Dimensional Data and Limited Simulations
• Health Data in an Open World
• ELFI: Engine for Likelihood-Free Inference
• Blind Justice: Fairness with Encrypted Sensitive Attributes
• Summary Statistics in Approximate Bayesian Computation
• G-SMOTE: A GMM-based synthetic minority oversampling technique for imbalanced learning
• Deep Variational Sufficient Dimensionality Reduction