Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification

Abstract

Deep convolutional neural network (DCNN) models have been widely explored for skin disease diagnosis and some of them have achieved the diagnostic outcomes comparable or even superior to those of dermatologists. However, broad implementation of DCNN in skin disease detection is hindered by small size and data imbalance of the publically accessible skin lesion datasets. This paper proposes a novel single-model based strategy for classification of skin lesions on small and imbalanced datasets. First, various DCNNs are trained on different small and imbalanced datasets to verify that the models with moderate complexity outperform the larger models. Second, regularization DropOut and DropBlock are added to reduce overfitting and a Modified RandAugment augmentation strategy is proposed to deal with the defects of sample underrepresentation in the small dataset. Finally, a novel Multi-Weighted New Loss (MWNL) function and an end-to-end cumulative learning strategy (CLS) are introduced to overcome the challenge of uneven sample size and classification difficulty and to reduce the impact of abnormal samples on training. By combining Modified RandAugment, MWNL and CLS, our single DCNN model method achieved the classification accuracy comparable or superior to those of multiple ensembling models on different dermoscopic image datasets. Our study shows that this method is able to achieve a high classification performance at a low cost of computational resources and inference time, potentially suitable to implement in mobile devices for automated screening of skin lesions and many other malignancies in low resource settings.

References in corpus (18)

• SMOTE: Synthetic Minority Over-sampling Technique
• A Survey on Deep Learning in Medical Image Analysis
• The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions
• Improved Regularization of Convolutional Neural Networks with Cutout
• Training Very Deep Networks
• Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
• A deep learning system for differential diagnosis of skin diseases
• DropBlock: A regularization method for convolutional networks
• Data Augmentation using Random Image Cropping and Patching for Deep CNNs
• Skin lesion detection based on an ensemble of deep convolutional neural network
• Deep Image: Scaling up Image Recognition
• BCN20000: Dermoscopic Lesions in the Wild
• Skin Lesion Classification Using CNNs with Patch-Based Attention and Diagnosis-Guided Loss Weighting
• Image Classification of Melanoma, Nevus and Seborrheic Keratosis by Deep Neural Network Ensemble
• RECOD Titans at ISIC Challenge 2017
• Incorporating the Knowledge of Dermatologists to Convolutional Neural Networks for the Diagnosis of Skin Lesions
• Skin Lesion Diagnosis using Ensembles, Unscaled Multi-Crop Evaluation and Loss Weighting
• Low-cost and high-performance data augmentation for deep-learning-based skin lesion classification

Cited by in corpus (4)

• A survey, review, and future trends of skin lesion segmentation and classification
• Meta-Transfer Derm-Diagnosis: Exploring Few-Shot Learning and Transfer Learning for Skin Disease Classification in Long-Tail Distribution
• Handling Class Imbalance Problem in Skin Lesion Classification: Finding Strengths and Weaknesses of Various Balancing Techniques
• Synthetic Melanoma Image Generation and Evaluation Using Generative Adversarial Networks