Personalised Federated Learning On Heterogeneous Feature Spaces
arXiv:2301.11447
Abstract
Most personalised federated learning (FL) approaches assume that raw data of all clients are defined in a common subspace i.e. all clients store their data according to the same schema. For real-world applications, this assumption is restrictive as clients, having their own systems to collect and then store data, may use heterogeneous data representations. We aim at filling this gap. To this end, we propose a general framework coined FLIC that maps client's data onto a common feature space via local embedding functions. The common feature space is learnt in a federated manner using Wasserstein barycenters while the local embedding functions are trained on each client via distribution alignment. We integrate this distribution alignement mechanism into a federated learning approach and provide the algorithmics of FLIC. We compare its performances against FL benchmarks involving heterogeneous input features spaces. In addition, we provide theoretical insights supporting the relevance of our methodology.
References in corpus (24)
- SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
- Secure Federated Transfer Learning
- Federated Machine Learning: Concept and Applications
- Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
- Improving Federated Learning Personalization via Model Agnostic Meta Learning
- On Mutual Information Maximization for Representation Learning
- Federated Learning of a Mixture of Global and Local Models
- HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients
- Word Representations via Gaussian Embedding
- Distribution Matching for Heterogeneous Multi-Task Learning: a Large-scale Face Study
- Lower Bounds and Optimal Algorithms for Personalized Federated Learning
- PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN
- Efficient Gaussian Sampling for Solving Large-Scale Inverse Problems using MCMC Methods
- FedAvg with Fine Tuning: Local Updates Lead to Representation Learning
- Towards Optimal Transport with Global Invariances
- Generalizing Point Embeddings using the Wasserstein Space of Elliptical Distributions
- PPFL: Privacy-preserving Federated Learning with Trusted Execution Environments
- High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm
- Learning Generative Models across Incomparable Spaces
- Asymmetric Private Set Intersection with Applications to Contact Tracing and Private Vertical Federated Machine Learning
- Learning Autoencoders with Relational Regularization
- Continual Horizontal Federated Learning for Heterogeneous Data
- The Fundamental Price of Secure Aggregation in Differentially Private Federated Learning
- Architecture Agnostic Federated Learning for Neural Networks