Multi-Participant Multi-Class Vertical Federated Learning

Abstract

Federated learning (FL) is a privacy-preserving paradigm for training collective machine learning models with locally stored data from multiple participants. Vertical federated learning (VFL) deals with the case where participants sharing the same sample ID space but having different feature spaces, while label information is owned by one participant. Current studies of VFL only support two participants, and mostly focus on binaryclass logistic regression problems. In this paper, we propose the Multi-participant Multi-class Vertical Federated Learning (MMVFL) framework for multi-class VFL problems involving multiple parties. Extending the idea of multi-view learning (MVL), MMVFL enables label sharing from its owner to other VFL participants in a privacypreserving manner. To demonstrate the effectiveness of MMVFL, a feature selection scheme is incorporated into MMVFL to compare its performance against supervised feature selection and MVL-based approaches. Experiment results on real-world datasets show that MMVFL can effectively share label information among multiple VFL participants and match multi-class classification performance of existing approaches.

References in corpus (8)

• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Federated Optimization: Distributed Machine Learning for On-Device Intelligence
• A Survey on Multi-view Learning
• Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
• Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator
• Entity Resolution and Federated Learning get a Federated Resolution
• A Communication Efficient Collaborative Learning Framework for Distributed Features
• A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

Cited by in corpus (18)

• From Distributed Machine Learning to Federated Learning: A Survey
• Vertical Federated Learning: Concepts, Advances and Challenges
• FedML: A Research Library and Benchmark for Federated Machine Learning
• Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics
• PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN
• Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies
• A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things
• Practical Vertical Federated Learning with Unsupervised Representation Learning
• Cross-Silo Federated Learning for Multi-Tier Networks with Vertical and Horizontal Data Partitioning
• Federated Graph Learning -- A Position Paper
• Asymmetric Private Set Intersection with Applications to Contact Tracing and Private Vertical Federated Machine Learning
• Self-supervised Cross-silo Federated Neural Architecture Search
• From Federated Learning to Federated Neural Architecture Search: A Survey
• Federated Learning on Non-IID Data: A Survey
• FedCTR: Federated Native Ad CTR Prediction with Multi-Platform User Behavior Data
• Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
• FedProf: Selective Federated Learning with Representation Profiling
• Management of Resource at the Network Edge for Federated Learning