Adaptive Input-image Normalization for Solving the Mode Collapse Problem in GAN-based X-ray Images

Abstract

Biomedical image datasets can be imbalanced due to the rarity of targeted diseases. Generative Adversarial Networks play a key role in addressing this imbalance by enabling the generation of synthetic images to augment datasets. It is important to generate synthetic images that incorporate a diverse range of features to accurately represent the distribution of features present in the training imagery. Furthermore, the absence of diverse features in synthetic images can degrade the performance of machine learning classifiers. The mode collapse problem impacts Generative Adversarial Networks' capacity to generate diversified images. Mode collapse comes in two varieties: intra-class and inter-class. In this paper, both varieties of the mode collapse problem are investigated, and their subsequent impact on the diversity of synthetic X-ray images is evaluated. This work contributes an empirical demonstration of the benefits of integrating the adaptive input-image normalization with the Deep Convolutional GAN and Auxiliary Classifier GAN to alleviate the mode collapse problems. Synthetically generated images are utilized for data augmentation and training a Vision Transformer model. The classification performance of the model is evaluated using accuracy, recall, and precision scores. Results demonstrate that the DCGAN and the ACGAN with adaptive input-image normalization outperform the DCGAN and ACGAN with un-normalized X-ray images as evidenced by the superior diversity scores and classification scores.

Submitted to the Elsevier Journal

References in corpus (12)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Conditional Generative Adversarial Nets
• Recent advances and clinical applications of deep learning in medical image analysis
• Alias-Free Generative Adversarial Networks
• CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection
• Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systems
• Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
• Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classification
• Enhanced Balancing GAN: Minority-class Image Generation
• Normalization of breast MRIs using Cycle-Consistent Generative Adversarial Networks
• Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Images
• Data Augmentation For Medical MR Image Using Generative Adversarial Networks