The Tradeoff Between Privacy and Accuracy in Anomaly Detection Using Federated XGBoost

Abstract

Privacy has raised considerable concerns recently, especially with the advent of information explosion and numerous data mining techniques to explore the information inside large volumes of data. In this context, a new distributed learning paradigm termed federated learning becomes prominent recently to tackle the privacy issues in distributed learning, where only learning models will be transmitted from the distributed nodes to servers without revealing users' own data and hence protecting the privacy of users. In this paper, we propose a horizontal federated XGBoost algorithm to solve the federated anomaly detection problem, where the anomaly detection aims to identify abnormalities from extremely unbalanced datasets and can be considered as a special classification problem. Our proposed federated XGBoost algorithm incorporates data aggregation and sparse federated update processes to balance the tradeoff between privacy and learning performance. In particular, we introduce the virtual data sample by aggregating a group of users' data together at a single distributed node. We compute parameters based on these virtual data samples in the local nodes and aggregate the learning model in the central server. In the learning model upgrading process, we focus more on the wrongly classified data before in the virtual sample and hence to generate sparse learning model parameters. By carefully controlling the size of these groups of samples, we can achieve a tradeoff between privacy and learning performance. Our experimental results show the effectiveness of our proposed scheme by comparing with existing state-of-the-arts.

References in corpus (7)

• SMOTE: Synthetic Minority Over-sampling Technique
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Federated Learning: Strategies for Improving Communication Efficiency
• Federated Learning for Mobile Keyboard Prediction
• Secure Federated Transfer Learning
• SecureBoost: A Lossless Federated Learning Framework
• Federated Deep Reinforcement Learning

Cited by in corpus (7)

• Privacy-Preserving Machine Learning: Methods, Challenges and Directions
• Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things
• Adaptive Histogram-Based Gradient Boosted Trees for Federated Learning
• Optimizing a Digital Twin for Fault Diagnosis in Grid Connected Inverters -- A Bayesian Approach
• Federated Learning on Non-IID Data: A Survey
• A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks
• Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Data