Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directions

Abstract

Learning from imbalanced data is among the most challenging areas in contemporary machine learning. This becomes even more difficult when considered the context of big data that calls for dedicated architectures capable of high-performance processing. Apache Spark is a highly efficient and popular architecture, but it poses specific challenges for algorithms to be implemented for it. While oversampling algorithms are an effective way for handling class imbalance, they have not been designed for distributed environments. In this paper, we propose a holistic look on oversampling algorithms for imbalanced big data. We discuss the taxonomy of oversampling algorithms and their mechanisms used to handle skewed class distributions. We introduce a Spark library with 14 state-of-the-art oversampling algorithms implemented and evaluate their efficacy via extensive experimental study. Using binary and multi-class massive data sets, we analyze the effectiveness of oversampling algorithms and their relationships with different types of classifiers. We evaluate the trade-off between accuracy and time complexity of oversampling algorithms, as well as their scalability when increasing the size of data. This allows us to gain insight into the usefulness of specific components of oversampling algorithms for big data, as well as formulate guidelines and recommendations for designing future resampling approaches for massive imbalanced data. Our library can be downloaded from https://github.com/fsleeman/spark-class-balancing.git.

52 pages, 9 tables, 13 figures, 15 algorithms

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• A Survey on Multi-view Learning
• Deep Learning for Classification of Hyperspectral Data: A Comparative Review
• A review on deep learning techniques for 3D sensed data classification
• EmbraceNet: A robust deep learning architecture for multimodal classification
• Multimodal music information processing and retrieval: survey and future challenges
• Multimodal Emotion Classification
• Multimodal price prediction

Cited by in corpus (5)

• Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysis
• Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review
• Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images
• MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields
• Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM