A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks

Abstract

Federated Learning (FL) has lately gained traction as it addresses how machine learning models train on distributed datasets. FL was designed for parametric models, namely Deep Neural Networks (DNNs).Thus, it has shown promise on image and text tasks. However, FL for tabular data has received little attention. Tree-Based Models (TBMs) have been considered to perform better on tabular data and they are starting to see FL integrations. In this study, we benchmark federated TBMs and DNNs for horizontal FL, with varying data partitions, on 10 well-known tabular datasets. Our novel benchmark results indicates that current federated boosted TBMs perform better than federated DNNs in different data partitions. Furthermore, a federated XGBoost outperforms all other models. Lastly, we find that federated TBMs perform better than federated parametric models, even when increasing the number of clients significantly.

8 pages, 6 figures, 6 tables, FMEC 2023 (best paper)

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Federated Learning: Challenges, Methods, and Future Directions
• Federated Learning: Strategies for Improving Communication Efficiency
• Towards Personalized Federated Learning
• Deep Neural Networks and Tabular Data: A Survey
• AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
• SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
• FedML: A Research Library and Benchmark for Federated Machine Learning
• TabTransformer: Tabular Data Modeling Using Contextual Embeddings
• A Hybrid Ensemble method for Pulsar Candidate Classification
• Deep Neural Decision Trees
• NVIDIA FLARE: Federated Learning from Simulation to Real-World
• The Tradeoff Between Privacy and Accuracy in Anomaly Detection Using Federated XGBoost
• FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations
• Federated Learning for Tabular Data using TabNet: A Vehicular Use-Case
• A Comparative Study of Machine Learning Models for Tabular Data Through Challenge of Monitoring Parkinson's Disease Progression Using Voice Recordings