FedML: A Research Library and Benchmark for Federated Machine Learning

Abstract

Federated learning (FL) is a rapidly growing research field in machine learning. However, existing FL libraries cannot adequately support diverse algorithmic development; inconsistent dataset and model usage make fair algorithm comparison challenging. In this work, we introduce FedML, an open research library and benchmark to facilitate FL algorithm development and fair performance comparison. FedML supports three computing paradigms: on-device training for edge devices, distributed computing, and single-machine simulation. FedML also promotes diverse algorithmic research with flexible and generic API design and comprehensive reference baseline implementations (optimizer, models, and datasets). We hope FedML could provide an efficient and reproducible means for developing and evaluating FL algorithms that would benefit the FL research community. We maintain the source code, documents, and user community at https://fedml.ai.

arXiv commentThis is FedML white paper V3. Homepage: https://fedml.ai; GitHub: https://github.com/FedML-AI/FedML; In V3, More advanced algorithms and IoT device training are supported, please check here: https://github.com/FedML-AI/FedML/blob/master/fedml_iot/

References in corpus (86)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
• Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
• Federated Learning for Mobile Keyboard Prediction
• Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
• On the Convergence of FedAvg on Non-IID Data
• Robust Aggregation for Federated Learning
• How To Backdoor Federated Learning
• SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• Secure Federated Transfer Learning
• Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
• Horovod: fast and easy distributed deep learning in TensorFlow
• Differentially Private Federated Learning: A Client Level Perspective
• FedMD: Heterogenous Federated Learning via Model Distillation
• EMNIST: an extension of MNIST to handwritten letters
• Federated Optimization in Heterogeneous Networks
• Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
• Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
• Can You Really Backdoor Federated Learning?
• Improving Federated Learning Personalization via Model Agnostic Meta Learning
• Personalized Federated Learning: A Meta-Learning Approach
• Mitigating Sybils in Federated Learning Poisoning
• Fair Resource Allocation in Federated Learning
• A generic framework for privacy preserving deep learning
• HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
• LEAF: A Benchmark for Federated Settings
• Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems
• Agnostic Federated Learning
• Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System
• MD-GAN: Multi-Discriminator Generative Adversarial Networks for Distributed Datasets
• Federated Learning with Bayesian Differential Privacy
• Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge
• Practical Secure Aggregation for Federated Learning on User-Held Data
• Communication Compression for Decentralized Training
• SecureBoost: A Lossless Federated Learning Framework
• Split learning for health: Distributed deep learning without sharing raw patient data
• Adaptive Federated Optimization
• Attack of the Tails: Yes, You Really Can Backdoor Federated Learning
• A Framework for Evaluating Gradient Leakage Attacks in Federated Learning
• Privacy in Deep Learning: A Survey
• Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator
• The Non-IID Data Quagmire of Decentralized Machine Learning
• Multi-Participant Multi-Class Vertical Federated Learning
• Entity Resolution and Federated Learning get a Federated Resolution
• Federated Multi-view Matrix Factorization for Personalized Recommendations
• Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization
• FADL:Federated-Autonomous Deep Learning for Distributed Electronic Health Record
• FetchSGD: Communication-Efficient Federated Learning with Sketching
• Central Server Free Federated Learning over Single-sided Trust Social Networks
• A Communication Efficient Collaborative Learning Framework for Distributed Features
• A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression
• Detailed comparison of communication efficiency of split learning and federated learning
• Generative Models for Effective ML on Private, Decentralized Datasets
• Federated Learning with Only Positive Labels
• Backdoor attacks and defenses in feature-partitioned collaborative learning
• Multi-consensus Decentralized Accelerated Gradient Descent
• Federated Learning With Quantized Global Model Updates
• Asymmetrical Vertical Federated Learning
• Towards Non-I.I.D. and Invisible Data with FedNAS: Federated Deep Learning via Neural Architecture Search
• Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
• Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention
• Federated Learning with Compression: Unified Analysis and Sharp Guarantees
• Client-Edge-Cloud Hierarchical Federated Learning
• Decentralized Bayesian Learning over Graphs
• Federated pretraining and fine tuning of BERT using clinical notes from multiple silos
• Towards Federated Learning in UAV-Enabled Internet of Vehicles: A Multi-Dimensional Contract-Matching Approach
• Federated Neural Architecture Search
• $\text{DeepSqueeze}$: Decentralization Meets Error-Compensated Compression
• FedCoin: A Peer-to-Peer Payment System for Federated Learning
• Backdoor Attacks on Federated Meta-Learning
• Federated Learning of N-gram Language Models
• Robust Federated Recommendation System
• FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing
• HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning
• Exploiting Unlabeled Data in Smart Cities using Federated Learning
• Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection
• Coded Computing for Federated Learning at the Edge
• From Local SGD to Local Fixed-Point Methods for Federated Learning
• Federated Learning Meets Contract Theory: Energy-Efficient Framework for Electric Vehicle Networks
• ExpertMatcher: Automating ML Model Selection for Clients using Hidden Representations
• Cloud-based Federated Boosting for Mobile Crowdsensing
• Federated Hierarchical Hybrid Networks for Clickbait Detection
• Federated Imitation Learning: A Privacy Considered Imitation Learning Framework for Cloud Robotic Systems with Heterogeneous Sensor Data
• Practical Privacy Preserving POI Recommendation

Cited by in corpus (72)

• A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
• Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challenges
• Vertical Federated Learning: Concepts, Advances and Challenges
• FedBN: Federated Learning on Non-IID Features via Local Batch Normalization
• Federated Learning for Healthcare Domain - Pipeline, Applications and Challenges
• Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge
• A Field Guide to Federated Optimization
• Ground-Assisted Federated Learning in LEO Satellite Constellations
• FedGraphNN: A Federated Learning System and Benchmark for Graph Neural Networks
• Fedstellar: A Platform for Decentralized Federated Learning
• Federated Learning on Non-IID Data Silos: An Experimental Study
• Artificial Intelligence of Things: A Survey
• FedLab: A Flexible Federated Learning Framework
• Central Server Free Federated Learning over Single-sided Trust Social Networks
• PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN
• FedICT: Federated Multi-task Distillation for Multi-access Edge Computing
• The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems
• Federated Learning for Big Data: A Survey on Opportunities, Applications, and Future Directions
• FedCV: A Federated Learning Framework for Diverse Computer Vision Tasks
• FedScale: Benchmarking Model and System Performance of Federated Learning at Scale
• No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Data
• Robust Blockchained Federated Learning with Model Validation and Proof-of-Stake Inspired Consensus
• SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training
• BFRT: Blockchained Federated Learning for Real-time Traffic Flow Prediction
• Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies
• Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data
• Towards Non-I.I.D. and Invisible Data with FedNAS: Federated Deep Learning via Neural Architecture Search
• Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
• SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks
• Practical Defences Against Model Inversion Attacks for Split Neural Networks
• TornadoAggregate: Accurate and Scalable Federated Learning via the Ring-Based Architecture
• FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusion
• SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labeling
• GFL: A Decentralized Federated Learning Framework Based On Blockchain
• FedEval: A Holistic Evaluation Framework for Federated Learning
• FedJAX: Federated learning simulation with JAX
• Model-Contrastive Federated Learning
• FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning
• Decentralized Learning Made Easy with DecentralizePy
• CAFE: Catastrophic Data Leakage in Vertical Federated Learning
• Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly
• FedDebug: Systematic Debugging for Federated Learning Applications
• SSFL: Tackling Label Deficiency in Federated Learning via Personalized Self-Supervision
• Characterizing Impacts of Heterogeneity in Federated Learning upon Large-Scale Smartphone Data
• Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning
• FLEdge: Benchmarking Federated Machine Learning Applications in Edge Computing Systems
• FedSAUC: A Similarity-Aware Update Control for Communication-Efficient Federated Learning in Edge Computing
• DistFL: Distribution-aware Federated Learning for Mobile Scenarios
• ScaDLES: Scalable Deep Learning over Streaming data at the Edge
• Federated Learning on Non-IID Data: A Survey
• A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks
• FLAGS Framework for Comparative Analysis of Federated Learning Algorithms
• A Framework for testing Federated Learning algorithms using an edge-like environment
• Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent
• Source Inference Attacks in Federated Learning
• R-GAP: Recursive Gradient Attack on Privacy
• OpenFed: A Comprehensive and Versatile Open-Source Federated Learning Framework
• Sample Selection Using Multi-Task Autoencoders in Federated Learning with Non-IID Data
• LIA: Privacy-Preserving Data Quality Evaluation in Federated Learning Using a Lazy Influence Approximation
• FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis
• Federated learning with differential privacy and an untrusted aggregator
• Modality Bank: Learn multi-modality images across data centers without sharing medical data
• HyFed: A Hybrid Federated Framework for Privacy-preserving Machine Learning
• An Adaptive Clustering Scheme for Client Selections in Communication-Efficient Federated Learning
• Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection
• An Operator Splitting View of Federated Learning
• Direct Federated Neural Architecture Search
• On-device Federated Learning with Flower
• Syft 0.5: A Platform for Universally Deployable Structured Transparency
• FLBench: A Benchmark Suite for Federated Learning
• Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications
• Towards General-purpose Infrastructure for Protecting Scientific Data Under Study