Imbalanced Data Learning by Minority Class Augmentation using Capsule Adversarial Networks

Abstract

The fact that image datasets are often imbalanced poses an intense challenge for deep learning techniques. In this paper, we propose a method to restore the balance in imbalanced images, by coalescing two concurrent methods, generative adversarial networks (GANs) and capsule network. In our model, generative and discriminative networks play a novel competitive game, in which the generator generates samples towards specific classes from multivariate probabilities distribution. The discriminator of our model is designed in a way that while recognizing the real and fake samples, it is also requires to assign classes to the inputs. Since GAN approaches require fully observed data during training, when the training samples are imbalanced, the approaches might generate similar samples which leading to data overfitting. This problem is addressed by providing all the available information from both the class components jointly in the adversarial training. It improves learning from imbalanced data by incorporating the majority distribution structure in the generation of new minority samples. Furthermore, the generator is trained with feature matching loss function to improve the training convergence. In addition, prevents generation of outliers and does not affect majority class space. The evaluations show the effectiveness of our proposed methodology; in particular, the coalescing of capsule-GAN is effective at recognizing highly overlapping classes with much fewer parameters compared with the convolutional-GAN.

References in corpus (15)

• SMOTE: Synthetic Minority Over-sampling Technique
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Spectral Normalization for Generative Adversarial Networks
• Conditional Image Synthesis With Auxiliary Classifier GANs
• Improved Techniques for Training GANs
• Energy-based Generative Adversarial Network
• Data Augmentation Generative Adversarial Networks
• BAGAN: Data Augmentation with Balancing GAN
• Good Semi-supervised Learning that Requires a Bad GAN
• Capsule Networks against Medical Imaging Data Challenges
• Novelty Detection with GAN
• Clustering and Learning from Imbalanced Data
• Adversarial Classifier for Imbalanced Problems

Cited by in corpus (3)

• ImGAGN:Imbalanced Network Embedding via Generative Adversarial Graph Networks
• MetaBalance: High-Performance Neural Networks for Class-Imbalanced Data
• People Still Care About Facts: Twitter Users Engage More with Factual Discourse than Misinformation--A Comparison Between COVID and General Narratives on Twitter