Advances in Robust Federated Learning: A Survey with Heterogeneity Considerations

Abstract

In the field of heterogeneous federated learning (FL), the key challenge is to efficiently and collaboratively train models across multiple clients with different data distributions, model structures, task objectives, computational capabilities, and communication resources. This diversity leads to significant heterogeneity, which increases the complexity of model training. In this paper, we first outline the basic concepts of heterogeneous federated learning and summarize the research challenges in federated learning in terms of five aspects: data, model, task, device, and communication. In addition, we explore how existing state-of-the-art approaches cope with the heterogeneity of federated learning, and categorize and review these approaches at three different levels: data-level, model-level, and architecture-level. Subsequently, the paper extensively discusses privacy-preserving strategies in heterogeneous federated learning environments. Finally, the paper discusses current open issues and directions for future research, aiming to promote the further development of heterogeneous federated learning.

References in corpus (10)

• Federated Learning for Internet of Things: A Comprehensive Survey
• FedKD: Communication Efficient Federated Learning via Knowledge Distillation
• HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
• Feature Inference Attack on Model Predictions in Vertical Federated Learning
• Decentralized Federated Learning through Proxy Model Sharing
• A Decentralized Federated Learning Framework via Committee Mechanism with Convergence Guarantee
• Federated Learning for Computationally-Constrained Heterogeneous Devices: A Survey
• Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning
• Fedstellar: A Platform for Decentralized Federated Learning
• Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints

Cited by in corpus (2)

• Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challenges
• From Privacy to Trust in the Agentic Era: A Taxonomy of Challenges in Trustworthy Federated Learning Through the Lens of Trust Report 2.0