Federated Optimization: Distributed Machine Learning for On-Device Intelligence

Abstract

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a high-quality centralized model. We refer to this setting as Federated Optimization. In this setting, communication efficiency is of the utmost importance and minimizing the number of rounds of communication is the principal goal. A motivating example arises when we keep the training data locally on users' mobile devices instead of logging it to a data center for training. In federated optimziation, the devices are used as compute nodes performing computation on their local data in order to update a global model. We suppose that we have extremely large number of devices in the network --- as many as the number of users of a given service, each of which has only a tiny fraction of the total data available. In particular, we expect the number of data points available locally to be much smaller than the number of devices. Additionally, since different users generate data with different patterns, it is reasonable to assume that no device has a representative sample of the overall distribution. We show that existing algorithms are not suitable for this setting, and propose a new algorithm which shows encouraging experimental results for sparse convex problems. This work also sets a path for future research needed in the context of \federated optimization.

38 pages

References in corpus (28)

• Deep Learning with Differential Privacy
• HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent
• SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
• Federated Optimization:Distributed Optimization Beyond the Datacenter
• Optimal Distributed Online Prediction using Mini-Batches
• Communication Efficient Distributed Optimization using an Approximate Newton-type Method
• Stochastic Variance Reduction for Nonconvex Optimization
• Parallel Coordinate Descent for L1-Regularized Loss Minimization
• A Linearly-Convergent Stochastic L-BFGS Algorithm
• AIDE: Fast and Communication Efficient Distributed Optimization
• On Variance Reduction in Stochastic Gradient Descent and its Asynchronous Variants
• Why Random Reshuffling Beats Stochastic Gradient Descent
• Mini-Batch Primal and Dual Methods for SVMs
• Stop Wasting My Gradients: Practical SVRG
• Un-regularizing: approximate proximal point and faster stochastic algorithms for empirical risk minimization
• A Simple Practical Accelerated Method for Finite Sums
• Distributed Block Coordinate Descent for Minimizing Partially Separable Functions
• Tight Complexity Bounds for Optimizing Composite Objectives
• Distributed Stochastic Variance Reduced Gradient Methods and A Lower Bound for Communication Complexity
• Asynchronous stochastic convex optimization
• Distributed Mini-Batch SDCA
• Randomized Block Coordinate Descent for Online and Stochastic Optimization
• Primal Method for ERM with Flexible Mini-batching Schemes and Non-convex Losses
• Randomized Quasi-Newton Updates are Linearly Convergent Matrix Inversion Algorithms
• L1-Regularized Distributed Optimization: A Communication-Efficient Primal-Dual Framework
• ASAGA: Asynchronous Parallel SAGA
• Coordinate Descent Face-Off: Primal or Dual?
• An efficient distributed learning algorithm based on effective local functional approximations

Cited by in corpus (305)

• Federated Learning: Strategies for Improving Communication Efficiency
• A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
• A Survey on Consensus Mechanisms and Mining Strategy Management in Blockchain Networks
• Towards Federated Learning at Scale: System Design
• SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
• Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing
• Federated Machine Learning: Concept and Applications
• Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation
• Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
• Applied Federated Learning: Improving Google Keyboard Query Suggestions
• Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks
• Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation
• Precision Health Data: Requirements, Challenges and Existing Techniques for Data Security and Privacy
• Improving Federated Learning Personalization via Model Agnostic Meta Learning
• A Crowdsourcing Framework for On-Device Federated Learning
• Three Approaches for Personalization with Applications to Federated Learning
• Sound Event Detection: A Tutorial
• Agnostic Federated Learning
• Federated Learning of a Mixture of Global and Local Models
• Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks
• Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AI
• Real-time City-scale Ridesharing via Linear Assignment Problems
• Opportunities of Federated Learning in Connected, Cooperative and Automated Industrial Systems
• On Analog Gradient Descent Learning over Multiple Access Fading Channels
• A Field Guide to Federated Optimization
• Decentralized Federated Learning: A Survey on Security and Privacy
• A Unified Theory of Decentralized SGD with Changing Topology and Local Updates
• Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging
• Expanding the Reach of Federated Learning by Reducing Client Resource Requirements
• Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacy
• Robust Federated Learning in a Heterogeneous Environment
• Federated Learning in Mobile Edge Networks: A Comprehensive Survey
• Privacy-preserving Federated Learning for Residential Short Term Load Forecasting
• Federated Forest
• 6G White Paper on Edge Intelligence
• Battery-constrained Federated Edge Learning in UAV-enabled IoT for B5G/6G Networks
• A Federated Learning Aggregation Algorithm for Pervasive Computing: Evaluation and Comparison
• Variational Federated Multi-Task Learning
• Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks
• Federated Learning Based on Dynamic Regularization
• A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
• A Platform-Free Proof of Federated Learning Consensus Mechanism for Sustainable Blockchains
• Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator
• Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
• Computation Offloading with Multiple Agents in Edge-Computing-Supported IoT
• Deep Learning-based Patient Re-identification Is able to Exploit the Biometric Nature of Medical Chest X-ray Data
• VAFL: a Method of Vertical Asynchronous Federated Learning
• A Critical Review on the Use (and Misuse) of Differential Privacy in Machine Learning
• Adaptive Federated Learning in Resource Constrained Edge Computing Systems
• Joint Optimization of Communications and Federated Learning Over the Air
• Minimizing Latency for Secure Distributed Computing
• Multi-Participant Multi-Class Vertical Federated Learning
• Free-riders in Federated Learning: Attacks and Defenses
• A Survey of Privacy Vulnerabilities of Mobile Device Sensors
• Federated Multi-view Matrix Factorization for Personalized Recommendations
• Federated Learning for Healthcare Informatics
• A Systematic Survey of Blockchained Federated Learning
• FADL:Federated-Autonomous Deep Learning for Distributed Electronic Health Record
• Lower Bounds and Optimal Algorithms for Personalized Federated Learning
• HHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for Electroencephalography
• Federated Learning based Energy Demand Prediction with Clustered Aggregation
• Security and Privacy Issues in Deep Learning
• The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
• XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning
• Private Federated Learning with Domain Adaptation
• FedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling
• Dynamic Defense Against Byzantine Poisoning Attacks in Federated Learning
• BlindFL: Vertical Federated Machine Learning without Peeking into Your Data
• Delay Minimization for Federated Learning Over Wireless Communication Networks
• Energy Efficient Federated Learning Over Wireless Communication Networks
• A Federated Learning Framework for Healthcare IoT devices
• Federated Learning with Unbiased Gradient Aggregation and Controllable Meta Updating
• Throughput-Optimal Topology Design for Cross-Silo Federated Learning
• The OARF Benchmark Suite: Characterization and Implications for Federated Learning Systems
• Asynchronous Federated Learning on Heterogeneous Devices: A Survey
• FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
• Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning
• ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural Projections
• Model Pruning Enables Localized and Efficient Federated Learning for Yield Forecasting and Data Sharing
• A Survey of Multi-Access Edge Computing in 5G and Beyond: Fundamentals, Technology Integration, and State-of-the-Art
• Blockchain as a Service: A Decentralized and Secure Computing Paradigm
• Federated User Representation Learning
• Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data
• Auto-weighted Robust Federated Learning with Corrupted Data Sources
• Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach
• Data-Quality Based Scheduling for Federated Edge Learning
• Convergence Time Optimization for Federated Learning over Wireless Networks
• Stochastic, Distributed and Federated Optimization for Machine Learning
• CADeSH: Collaborative Anomaly Detection for Smart Homes
• Hierarchical Federated Learning through LAN-WAN Orchestration
• FedHybrid: A Hybrid Primal-Dual Algorithm Framework for Federated Optimization
• FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection
• GIANT: Globally Improved Approximate Newton Method for Distributed Optimization
• Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention
• A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things
• Mobile Edge Intelligence and Computing for the Internet of Vehicles
• A Vertical Federated Learning Framework for Graph Convolutional Network
• Communication-Efficient Local Decentralized SGD Methods
• How to Put Users in Control of their Data in Federated Top-N Recommendation with Learning to Rank
• Asynchronous Federated Learning with Differential Privacy for Edge Intelligence
• TornadoAggregate: Accurate and Scalable Federated Learning via the Ring-Based Architecture
• Privacy Preservation in Federated Learning: An insightful survey from the GDPR Perspective
• Distributed Training of Graph Convolutional Networks
• Collaborative Artificial Intelligence (AI) for User-Cell association in Ultra-Dense Cellular Systems
• Differentially Private Federated Clustering over Non-IID Data
• Evaluation and comparison of federated learning algorithms for Human Activity Recognition on smartphones
• Decentralized Bayesian Learning over Graphs
• FedGiA: An Efficient Hybrid Algorithm for Federated Learning
• Towards Federated Learning in UAV-Enabled Internet of Vehicles: A Multi-Dimensional Contract-Matching Approach
• FEDZIP: A Compression Framework for Communication-Efficient Federated Learning
• Fast Federated Learning in the Presence of Arbitrary Device Unavailability
• A Federated Learning Approach for Mobile Packet Classification
• Cross-Silo Federated Learning for Multi-Tier Networks with Vertical and Horizontal Data Partitioning
• A VCG-based Fair Incentive Mechanism for Federated Learning
• VFL: A Verifiable Federated Learning with Privacy-Preserving for Big Data in Industrial IoT
• STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning
• Cloud2Edge Elastic AI Framework for Prototyping and Deployment of AI Inference Engines in Autonomous Vehicles
• FedJAX: Federated learning simulation with JAX
• Federated learning for secure development of AI models for Parkinson's disease detection using speech from different languages
• Preserving Patient Privacy while Training a Predictive Model of In-hospital Mortality
• Interpret Federated Learning with Shapley Values
• Contrastive encoder pre-training-based clustered federated learning for heterogeneous data
• Differentially Private Federated Learning for Resource-Constrained Internet of Things
• An On-Device Federated Learning Approach for Cooperative Model Update between Edge Devices
• Federated Learning of N-gram Language Models
• Personalized Federated Deep Learning for Pain Estimation From Face Images
• Asynchronous Online Federated Learning for Edge Devices with Non-IID Data
• Asynchronous Federated Learning with Reduced Number of Rounds and with Differential Privacy from Less Aggregated Gaussian Noise
• User Consented Federated Recommender System Against Personalized Attribute Inference Attack
• Scaling-up Distributed Processing of Data Streams for Machine Learning
• On Safeguarding Privacy and Security in the Framework of Federated Learning
• Federated Over-Air Subspace Tracking from Incomplete and Corrupted Data
• Communication-Efficient ADMM-based Federated Learning
• OODIDA: On-board/Off-board Distributed Real-Time Data Analytics for Connected Vehicles
• Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective
• ARFED: Attack-Resistant Federated averaging based on outlier elimination
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms
• COVID-19 Imaging Data Privacy by Federated Learning Design: A Theoretical Framework
• Accurate and Fast Federated Learning via IID and Communication-Aware Grouping
• Federated Learning for Energy Constrained IoT devices: A systematic mapping study
• Blockchained On-Device Federated Learning
• Distributed Learning of Deep Neural Networks using Independent Subnet Training
• Effective Federated Adaptive Gradient Methods with Non-IID Decentralized Data
• HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning
• Data Poisoning Attacks on Federated Machine Learning
• Personalized Graph Federated Learning with Differential Privacy
• Ternary Compression for Communication-Efficient Federated Learning
• Parallel Restarted SPIDER -- Communication Efficient Distributed Nonconvex Optimization with Optimal Computation Complexity
• Orchestrating the Development Lifecycle of Machine Learning-Based IoT Applications: A Taxonomy and Survey
• Security and Privacy for Artificial Intelligence: Opportunities and Challenges
• FedDR -- Randomized Douglas-Rachford Splitting Algorithms for Nonconvex Federated Composite Optimization
• Gradient Descent with Compressed Iterates
• Efficient Learning of Interpretable Classification Rules
• Privacy Threats Against Federated Matrix Factorization
• What Do We Mean by Generalization in Federated Learning?
• FedNL: Making Newton-Type Methods Applicable to Federated Learning
• Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency
• rTop-k: A Statistical Estimation Approach to Distributed SGD
• Variance-Reduced Stochastic Learning under Random Reshuffling
• Turn Signal Prediction: A Federated Learning Case Study
• Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM
• Strategic Coalition for Data Pricing in IoT Data Markets
• A Vertical Federated Learning Framework for Horizontally Partitioned Labels
• Asynchronous Online Federated Learning with Reduced Communication Requirements
• Low Precision Decentralized Distributed Training over IID and non-IID Data
• Personalized Federated Learning with Gaussian Processes
• Applications of Federated Learning in Smart Cities: Recent Advances, Taxonomy, and Open Challenges
• Prototype of deployment of Federated Learning with IoT devices
• Privacy-Preserving Blockchain Based Federated Learning with Differential Data Sharing
• Blockchain-Based Federated Learning in Mobile Edge Networks with Application in Internet of Vehicles
• Gradient Scheduling with Global Momentum for Non-IID Data Distributed Asynchronous Training
• Active Learning Solution on Distributed Edge Computing
• On Convergence of Distributed Approximate Newton Methods: Globalization, Sharper Bounds and Beyond
• Characterizing Impacts of Heterogeneity in Federated Learning upon Large-Scale Smartphone Data
• Faster Non-Convex Federated Learning via Global and Local Momentum
• Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving
• Adaptive Federated Dropout: Improving Communication Efficiency and Generalization for Federated Learning
• Federated Semi-Supervised Learning with Class Distribution Mismatch
• Joint Service Pricing and Cooperative Relay Communication for Federated Learning
• Efficient Federated Learning over Multiple Access Channel with Differential Privacy Constraints
• Federated Learning -- Methods, Applications and beyond
• Certifiably-Robust Federated Adversarial Learning via Randomized Smoothing
• Federated Learning on Non-iid Data via Local and Global Distillation
• Wireless for Machine Learning
• Proof of Learning (PoLe): Empowering Machine Learning with Consensus Building on Blockchains
• Error Compensated Distributed SGD Can Be Accelerated
• Fed-EC: Bandwidth-Efficient Clustering-Based Federated Learning For Autonomous Visual Robot Navigation
• Randomized Distributed Mean Estimation: Accuracy vs Communication
• FedPAGE: A Fast Local Stochastic Gradient Method for Communication-Efficient Federated Learning
• Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning
• Unified Group Fairness on Federated Learning
• Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
• Federated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks
• Mitigating Leakage in Federated Learning with Trusted Hardware
• FLEE-GNN: A Federated Learning System for Edge-Enhanced Graph Neural Network in Analyzing Geospatial Resilience of Multicommodity Food Flows
• Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach
• SoK: Training Machine Learning Models over Multiple Sources with Privacy Preservation
• Real-time End-to-End Federated Learning: An Automotive Case Study
• Federated Learning for Keyword Spotting
• Byzantine-Robust Variance-Reduced Federated Learning over Distributed Non-i.i.d. Data
• Decentralized Proactive Model Offloading and Resource Allocation for Split and Federated Learning
• Federated Learning in ASR: Not as Easy as You Think
• FedDis: Disentangled Federated Learning for Unsupervised Brain Pathology Segmentation
• Latency-Aware Radio Resource Optimization in Learning-Based Cloud-Aided Small Cell Wireless Networks
• Federated Multi-Armed Bandits
• OCTOPUS: Overcoming Performance andPrivatization Bottlenecks in Distributed Learning
• Anarchic Federated Learning
• ESMFL: Efficient and Secure Models for Federated Learning
• Evaluating the Impact of Privacy-Preserving Federated Learning on CAN Intrusion Detection
• Optimal Model Averaging: Towards Personalized Collaborative Learning
• Federated Learning and catastrophic forgetting in pervasive computing: demonstration in HAR domain
• A Framework for testing Federated Learning algorithms using an edge-like environment
• Resource-Constrained Federated Learning with Heterogeneous Labels and Models
• Blockchain Assisted Decentralized Federated Learning (BLADE-FL) with Lazy Clients
• Accurate and Fast Federated Learning via Combinatorial Multi-Armed Bandits
• Distributed Newton Can Communicate Less and Resist Byzantine Workers
• Federated Stochastic Gradient Langevin Dynamics
• Delay Analysis of Wireless Federated Learning Based on Saddle Point Approximation and Large Deviation Theory
• Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning
• Federated Hierarchical Hybrid Networks for Clickbait Detection
• Federated AI lets a team imagine together: Federated Learning of GANs
• Training Neural Networks with Fixed Sparse Masks
• Low-Rank Training of Deep Neural Networks for Emerging Memory Technology
• Adaptive Sampling Distributed Stochastic Variance Reduced Gradient for Heterogeneous Distributed Datasets
• A Phone-based Distributed Ambient Temperature Measurement System with An Efficient Label-free Automated Training Strategy
• Data-aided Sensing where Communication and Sensing Meet: An Introduction
• An Element-Wise Weights Aggregation Method for Federated Learning
• Federated Learning with Heterogeneous Labels and Models for Mobile Activity Monitoring
• Synthetic data shuffling accelerates the convergence of federated learning under data heterogeneity
• Communication Efficient Federated Learning with Energy Awareness over Wireless Networks
• FTPipeHD: A Fault-Tolerant Pipeline-Parallel Distributed Training Framework for Heterogeneous Edge Devices
• DISH: A Distributed Hybrid Primal-Dual Optimization Framework to Utilize System Heterogeneity
• Confined Gradient Descent: Privacy-preserving Optimization for Federated Learning
• High Dimensional Restrictive Federated Model Selection with multi-objective Bayesian Optimization over shifted distributions
• Research on Resource Allocation for Efficient Federated Learning
• Device Scheduling and Update Aggregation Policies for Asynchronous Federated Learning
• On Large-Cohort Training for Federated Learning
• Privacy-Preserving Federated Learning on Partitioned Attributes
• Privacy Preserving for Medical Image Analysis via Non-Linear Deformation Proxy
• Cost-Effective Federated Learning Design
• Federated Unlearning
• Cross-Gradient Aggregation for Decentralized Learning from Non-IID data
• Multi-Task Federated Reinforcement Learning with Adversaries
• Global Multiclass Classification and Dataset Construction via Heterogeneous Local Experts
• Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
• FedGraph: Federated Graph Learning with Intelligent Sampling
• An Energy and Carbon Footprint Analysis of Distributed and Federated Learning
• Communication-Efficient Agnostic Federated Averaging
• Communication-Efficient Distributed SGD using Preamble-based Random Access
• Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time
• Defending Against Diverse Attacks in Federated Learning Through Consensus-Based Bi-Level Optimization
• Programming and Deployment of Autonomous Swarms using Multi-Agent Reinforcement Learning
• FedDropoutAvg: Generalizable federated learning for histopathology image classification
• Glimmers: Resolving the Privacy/Trust Quagmire
• Scalable Learning Paradigms for Data-Driven Wireless Communication
• Federated Extra-Trees with Privacy Preserving
• Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes
• Representation of Federated Learning via Worst-Case Robust Optimization Theory
• Towards Inference Delivery Networks: Distributing Machine Learning with Optimality Guarantees
• Distributed Stochastic Non-Convex Optimization: Momentum-Based Variance Reduction
• MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing
• Faster Secure Data Mining via Distributed Homomorphic Encryption
• Interpretable collaborative data analysis on distributed data
• Fair and autonomous sharing of federate learning models in mobile Internet of Things
• Sparse sketches with small inversion bias
• Accelerated Randomized Coordinate Descent Algorithms for Stochastic Optimization and Online Learning
• Federating for Learning Group Fair Models
• Continual Distributed Learning for Crisis Management
• A Quantitative Metric for Privacy Leakage in Federated Learning
• A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning
• Secure Machine Learning over Relational Data
• Slashing Communication Traffic in Federated Learning by Transmitting Clustered Model Updates
• Beyond privacy regulations: an ethical approach to data usage in transportation
• Gain without Pain: Offsetting DP-injected Nosies Stealthily in Cross-device Federated Learning
• A Federated Data-Driven Evolutionary Algorithm
• Variance-Reduced Stochastic Learning by Networked Agents under Random Reshuffling
• Utility Fairness for the Differentially Private Federated Learning
• Local Learning at the Network Edge for Efficient & Secure Real-Time Predictive Analytics
• Fault-Tolerant Federated Reinforcement Learning with Theoretical Guarantee
• On the Energy and Communication Efficiency Tradeoffs in Federated and Multi-Task Learning
• Distributed Map Classification using Local Observations
• FLBench: A Benchmark Suite for Federated Learning
• Practical Newton-Type Distributed Learning using Gradient Based Approximations
• Mobility-Aware Routing and Caching: A Federated Learning Assisted Approach
• Escaping Saddle Points in Distributed Newton's Method with Communication Efficiency and Byzantine Resilience
• Federated Marginal Personalization for ASR Rescoring
• The Confluence of Networks, Games and Learning
• Latency Analysis of Consortium Blockchained Federated Learning
• Distributed Learning with Low Communication Cost via Gradient Boosting Untrained Neural Network
• Multi-task Federated Edge Learning (MtFEEL) in Wireless Networks
• Linear Speedup in Personalized Collaborative Learning
• Lightwave Power Transfer for Federated Learning-based Wireless Networks
• On the Convergence of Inexact Gradient Descent with Controlled Synchronization Steps
• Distantly Supervised Relation Extraction in Federated Settings
• Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters
• GraphFederator: Federated Visual Analysis for Multi-party Graphs
• Federated Classification using Parsimonious Functions in Reproducing Kernel Hilbert Spaces
• Federated Topic Model and Model Pruning Based on Variational Autoencoder
• Distributed Collapsed Gibbs Sampler for Dirichlet Process Mixture Models in Federated Learning
• FedOptima: Optimizing Resource Utilization in Federated Learning
• Kalman Filter Aided Federated Koopman Learning
• How Much Are You Willing to Share? A "Poker-Styled" Selective Privacy Preserving Framework for Recommender Systems
• Distributed Learning and its Application for Time-Series Prediction
• Towards Explainable Multi-Party Learning: A Contrastive Knowledge Sharing Framework
• Design and Analysis of Uplink and Downlink Communications for Federated Learning