FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data
arXiv:2103.03918
Abstract
Federated learning (FL) has been proposed to allow collaborative training of machine learning (ML) models among multiple parties where each party can keep its data private. In this paradigm, only model updates, such as model weights or gradients, are shared. Many existing approaches have focused on horizontal FL, where each party has the entire feature set and labels in the training data set. However, many real scenarios follow a vertically-partitioned FL setup, where a complete feature set is formed only when all the datasets from the parties are combined, and the labels are only available to a single party. Privacy-preserving vertical FL is challenging because complete sets of labels and features are not owned by one entity. Existing approaches for vertical FL require multiple peer-to-peer communications among parties, leading to lengthy training times, and are restricted to (approximated) linear models and just two parties. To close this gap, we propose FedV, a framework for secure gradient computation in vertical settings for several widely used ML models such as linear models, logistic regression, and support vector machines. FedV removes the need for peer-to-peer communication among parties by using functional encryption schemes; this allows FedV to achieve faster training times. It also works for larger and changing sets of parties. We empirically demonstrate the applicability for multiple types of ML models and show a reduction of 10%-70% of training time and 80% to 90% in data transfer with respect to the state-of-the-art approaches.
References in corpus (19)
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Federated Learning: Strategies for Improving Communication Efficiency
- Federated Learning with Non-IID Data
- Towards Federated Learning at Scale: System Design
- How To Backdoor Federated Learning
- Differentially Private Federated Learning: A Client Level Perspective
- Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
- HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
- Detecting Backdoor Attacks on Deep Neural Networks by Activation Clustering
- SecureBoost: A Lossless Federated Learning Framework
- Split learning for health: Distributed deep learning without sharing raw patient data
- Variational Federated Multi-Task Learning
- IBM Federated Learning: an Enterprise Framework White Paper V0.1
- VAFL: a Method of Vertical Asynchronous Federated Learning
- Entity Resolution and Federated Learning get a Federated Resolution
- A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression
- Detailed comparison of communication efficiency of split learning and federated learning
- Hybrid Differentially Private Federated Learning on Vertically Partitioned Data
- Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating