CosSIF: Cosine similarity-based image filtering to overcome low inter-class variation in synthetic medical image datasets

Abstract

Crafting effective deep learning models for medical image analysis is a complex task, particularly in cases where the medical image dataset lacks significant inter-class variation. This challenge is further aggravated when employing such datasets to generate synthetic images using generative adversarial networks (GANs), as the output of GANs heavily relies on the input data. In this research, we propose a novel filtering algorithm called Cosine Similarity-based Image Filtering (CosSIF). We leverage CosSIF to develop two distinct filtering methods: Filtering Before GAN Training (FBGT) and Filtering After GAN Training (FAGT). FBGT involves the removal of real images that exhibit similarities to images of other classes before utilizing them as the training dataset for a GAN. On the other hand, FAGT focuses on eliminating synthetic images with less discriminative features compared to real images used for training the GAN. Experimental results reveal that employing either the FAGT or FBGT method with modern transformer and convolutional-based networks leads to substantial performance gains in various evaluation metrics. FAGT implementation on the ISIC-2016 dataset surpasses the baseline method in terms of sensitivity by 1.59% and AUC by 1.88%. Furthermore, for the HAM10000 dataset, applying FABT outperforms the baseline approach in terms of recall by 13.75%, and with the sole implementation of FAGT, achieves a maximum accuracy of 94.44%.

arXiv comment18 pages, 20 figures

References in corpus (9)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• A Survey on Deep Learning in Medical Image Analysis
• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• Generative Adversarial Networks: An Overview
• The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions
• Confounding variables can degrade generalization performance of radiological deep learning models
• Training Generative Adversarial Networks with Limited Data
• Skin Lesion Analysis toward Melanoma Detection: A Challenge at the International Symposium on Biomedical Imaging (ISBI) 2016, hosted by the International Skin Imaging Collaboration (ISIC)
• Melanoma Detection using Adversarial Training and Deep Transfer Learning

Cited by in corpus (2)

• CoTCoNet: An Optimized Coupled Transformer-Convolutional Network with an Adaptive Graph Reconstruction for Leukemia Detection
• Recent Advances in Medical Image Classification