Federated Learning for Commercial Image Sources

Abstract

Federated Learning is a collaborative machine learning paradigm that enables multiple clients to learn a global model without exposing their data to each other. Consequently, it provides a secure learning platform with privacy-preserving capabilities. This paper introduces a new dataset containing 23,326 images collected from eight different commercial sources and classified into 31 categories, similar to the Office-31 dataset. To the best of our knowledge, this is the first image classification dataset specifically designed for Federated Learning. We also propose two new Federated Learning algorithms, namely Fed-Cyclic and Fed-Star. In Fed-Cyclic, a client receives weights from its previous client, updates them through local training, and passes them to the next client, thus forming a cyclic topology. In Fed-Star, a client receives weights from all other clients, updates its local weights through pre-aggregation (to address statistical heterogeneity) and local training, and sends its updated local weights to all other clients, thus forming a star-like topology. Our experiments reveal that both algorithms perform better than existing baselines on our newly introduced dataset.

Published in the Proceedings of IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023 with DOI: 10.1109/WACV56688.2023.00647

References in corpus (20)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Federated Learning: Challenges, Methods, and Future Directions
• Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
• Federated Learning: Strategies for Improving Communication Efficiency
• Federated Learning with Non-IID Data
• Federated Learning for Internet of Things: A Comprehensive Survey
• Towards Personalized Federated Learning
• On the Convergence of FedAvg on Non-IID Data
• Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification
• Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization
• Optimal Distributed Online Prediction using Mini-Batches
• Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
• Adaptive Personalized Federated Learning
• Three Approaches for Personalization with Applications to Federated Learning
• Distributed Coordinate Descent Method for Learning with Big Data
• FedGroup: Efficient Clustered Federated Learning via Decomposed Data-Driven Measure
• Variance Reduced Local SGD with Lower Communication Complexity
• Real-World Image Datasets for Federated Learning
• FedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling
• RingFed: Reducing Communication Costs in Federated Learning on Non-IID Data