FOCUS: Dealing with Label Quality Disparity in Federated Learning

Abstract

Ubiquitous systems with End-Edge-Cloud architecture are increasingly being used in healthcare applications. Federated Learning (FL) is highly useful for such applications, due to silo effect and privacy preserving. Existing FL approaches generally do not account for disparities in the quality of local data labels. However, the clients in ubiquitous systems tend to suffer from label noise due to varying skill-levels, biases or malicious tampering of the annotators. In this paper, we propose Federated Opportunistic Computing for Ubiquitous Systems (FOCUS) to address this challenge. It maintains a small set of benchmark samples on the FL server and quantifies the credibility of the client local data without directly observing them by computing the mutual cross-entropy between performance of the FL model on the local datasets and that of the client local FL model on the benchmark dataset. Then, a credit weighted orchestration is performed to adjust the weight assigned to clients in the FL model based on their credibility values. FOCUS has been experimentally evaluated on both synthetic data and real-world data. The results show that it effectively identifies clients with noisy labels and reduces their impact on the model performance, thereby significantly outperforming existing FL approaches.

arXiv comment7 pages

References in corpus (1)

• Zeno: Distributed Stochastic Gradient Descent with Suspicion-based Fault-tolerance

Cited by in corpus (6)

• Communication-Efficient Robust Federated Learning with Noisy Labels
• A Systematic Literature Review on Federated Learning: From A Model Quality Perspective
• Secure Weighted Aggregation for Federated Learning
• FedDebug: Systematic Debugging for Federated Learning Applications
• Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
• Enabling SQL-based Training Data Debugging for Federated Learning