Federated Learning with Personalization Layers
arXiv:1912.00818
Abstract
The emerging paradigm of federated learning strives to enable collaborative training of machine learning models on the network edge without centrally aggregating raw data and hence, improving data privacy. This sharply deviates from traditional machine learning and necessitates the design of algorithms robust to various sources of heterogeneity. Specifically, statistical heterogeneity of data across user devices can severely degrade the performance of standard federated averaging for traditional machine learning applications like personalization with deep learning. This paper pro-posesFedPer, a base + personalization layer approach for federated training of deep feedforward neural networks, which can combat the ill-effects of statistical heterogeneity. We demonstrate effectiveness ofFedPerfor non-identical data partitions ofCIFARdatasetsand on a personalized image aesthetics dataset from Flickr.
References in corpus (3)
Cited by in corpus (58)
- From Distributed Machine Learning to Federated Learning: A Survey
- Adaptive Personalized Federated Learning
- Three Approaches for Personalization with Applications to Federated Learning
- Personalized Federated Learning with Moreau Envelopes
- A Field Guide to Federated Optimization
- Federated Learning in Mobile Edge Networks: A Comprehensive Survey
- A Federated Learning Aggregation Algorithm for Pervasive Computing: Evaluation and Comparison
- Federated Continual Learning via Knowledge Fusion: A Survey
- FedCP: Separating Feature Information for Personalized Federated Learning via Conditional Policy
- A review of federated learning in renewable energy applications: Potential, challenges, and future directions
- Exploiting Shared Representations for Personalized Federated Learning
- The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
- FedBABU: Towards Enhanced Representation for Federated Image Classification
- FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systems
- No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data
- A distillation-based approach integrating continual learning and federated learning for pervasive services
- Privacy-Aware Energy Consumption Modeling of Connected Battery Electric Vehicles using Federated Learning
- Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learning
- Graph Federated Learning for CIoT Devices in Smart Home Applications
- Federated learning-outcome prediction with multi-layer privacy protection
- Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge based Framework
- Parameterized Knowledge Transfer for Personalized Federated Learning
- Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones
- Federated Reconstruction: Partially Local Federated Learning
- Uncertainty Minimization for Personalized Federated Semi-Supervised Learning
- FedRFQ: Prototype-Based Federated Learning with Reduced Redundancy, Minimal Failure, and Enhanced Quality
- Multi-Modal Federated Learning for Cancer Staging over Non-IID Datasets with Unbalanced Modalities
- Connecting Low-Loss Subspace for Personalized Federated Learning
- Federated brain tumor segmentation: an extensive benchmark
- FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning
- Specialized federated learning using a mixture of experts
- You Can Backdoor Personalized Federated Learning
- FedBoosting: Federated Learning with Gradient Protected Boosting for Text Recognition
- Federated Transfer Learning with Task Personalization for Condition Monitoring in Ultrasonic Metal Welding
- Federated Learning for Chronic Obstructive Pulmonary Disease Classification with Partial Personalized Attention Mechanism
- Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning
- Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion
- Personalized Federated Learning with Gaussian Processes
- Minimax Estimation for Personalized Federated Learning: An Alternative between FedAvg and Local Training?
- Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data
- Personalized Federated Learning with Multi-branch Architecture
- Federated Learning on Non-IID Data: A Survey
- Aggregate or Not? Exploring Where to Privatize in DNN Based Federated Learning Under Different Non-IID Scenes
- Towards Fair Federated Learning with Zero-Shot Data Augmentation
- Federated Block Coordinate Descent Scheme for Learning Global and Personalized Models
- Personalized Federated Learning: A Unified Framework and Universal Optimization Techniques
- Privacy Assessment of Federated Learning using Private Personalized Layers
- Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domain
- Modular Federated Learning
- IFedAvg: Interpretable Data-Interoperability for Federated Learning
- FedHealth 2: Weighted Federated Transfer Learning via Batch Normalization for Personalized Healthcare
- Uncertainty-Aware Label Refinement on Hypergraphs for Personalized Federated Facial Expression Recognition
- Federated Learning for Open Banking
- Preliminary Steps Towards Federated Sentiment Classification
- Demystifying the Effects of Non-Independence in Federated Learning
- Canoe : A System for Collaborative Learning for Neural Nets
- CatFedAvg: Optimising Communication-efficiency and Classification Accuracy in Federated Learning
- A Personalized Federated Learning Algorithm: an Application in Anomaly Detection