Privacy Preserving Distributed Machine Learning with Federated Learning

Abstract

Edge computing and distributed machine learning have advanced to a level that can revolutionize a particular organization. Distributed devices such as the Internet of Things (IoT) often produce a large amount of data, eventually resulting in big data that can be vital in uncovering hidden patterns, and other insights in numerous fields such as healthcare, banking, and policing. Data related to areas such as healthcare and banking can contain potentially sensitive data that can become public if they are not appropriately sanitized. Federated learning (FedML) is a recently developed distributed machine learning (DML) approach that tries to preserve privacy by bringing the learning of an ML model to data owners'. However, literature shows different attack methods such as membership inference that exploit the vulnerabilities of ML models as well as the coordinating servers to retrieve private data. Hence, FedML needs additional measures to guarantee data privacy. Furthermore, big data often requires more resources than available in a standard computer. This paper addresses these issues by proposing a distributed perturbation algorithm named as DISTPAB, for privacy preservation of horizontally partitioned data. DISTPAB alleviates computational bottlenecks by distributing the task of privacy preservation utilizing the asymmetry of resources of a distributed environment, which can have resource-constrained devices as well as high-performance computers. Experiments show that DISTPAB provides high accuracy, high efficiency, high scalability, and high attack resistance. Further experiments on privacy-preserving FedML show that DISTPAB is an excellent solution to stop privacy leaks in DML while preserving high data utility.

References in corpus (8)

• Towards Federated Learning at Scale: System Design
• Federated Machine Learning: Concept and Applications
• Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption
• Efficient privacy preservation of big data for accurate data mining
• t-Closeness through Microaggregation: Strict Privacy with Enhanced Utility Preservation
• Efficient Data Perturbation for Privacy Preserving and Accurate Data Stream Mining
• An Efficient and Scalable Privacy Preserving Algorithm for Big Data and Data Streams
• SplitFed: When Federated Learning Meets Split Learning

Cited by in corpus (5)

• On the Opportunities and Risks of Foundation Models
• Privacy Preserving Face Recognition Utilizing Differential Privacy
• A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspective
• Applications of Federated Learning in Smart Cities: Recent Advances, Taxonomy, and Open Challenges
• Distantly Supervised Relation Extraction in Federated Settings