Segmentation of Skin Lesions and their Attributes Using Multi-Scale Convolutional Neural Networks and Domain Specific Augmentations

Abstract

Computer-aided diagnosis systems for classification of different type of skin lesions have been an active field of research in recent decades. It has been shown that introducing lesions and their attributes masks into lesion classification pipeline can greatly improve the performance. In this paper, we propose a framework by incorporating transfer learning for segmenting lesions and their attributes based on the convolutional neural networks. The proposed framework is based on the encoder-decoder architecture which utilizes a variety of pre-trained networks in the encoding path and generates the prediction map by combining multi-scale information in decoding path using a pyramid pooling manner. To address the lack of training data and increase the proposed model generalization, an extensive set of novel domain-specific augmentation routines have been applied to simulate the real variations in dermoscopy images. Finally, by performing broad experiments on three different data sets obtained from International Skin Imaging Collaboration archive (ISIC2016, ISIC2017, and ISIC2018 challenges data sets), we show that the proposed method outperforms other state-of-the-art approaches for ISIC2016 and ISIC2017 segmentation task and achieved the first rank on the leader-board of ISIC2018 attribute detection task.

arXiv comment18 pages

References in corpus (13)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• A Survey on Deep Learning in Medical Image Analysis
• Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
• On the Convergence of Adam and Beyond
• Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks
• RECOD Titans at ISIC Challenge 2017
• ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detection
• Supervised Saliency Map Driven Segmentation of the Lesions in Dermoscopic Images
• Data-Driven Color Augmentation Techniques for Deep Skin Image Analysis
• A Detection and Segmentation Architecture for Skin Lesion Segmentation on Dermoscopy Images
• Deep-Learning Ensembles for Skin-Lesion Segmentation, Analysis, Classification: RECOD Titans at ISIC Challenge 2018
• Lesion Analysis and Diagnosis with Mask-RCNN
• Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks

Cited by in corpus (7)

• A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
• A Survey on Deep Learning for Skin Lesion Segmentation
• Automated skin lesion segmentation using multi-scale feature extraction scheme and dual-attention mechanism
• NuClick: A Deep Learning Framework for Interactive Segmentation of Microscopy Images
• NuClick: From Clicks in the Nuclei to Nuclear Boundaries
• Automatic Recognition of the Supraspinatus Tendinopathy from Ultrasound Images using Convolutional Neural Networks
• SANet:Superpixel Attention Network for Skin Lesion Attributes Detection