Uncertainty and Interpretability in Convolutional Neural Networks for Semantic Segmentation of Colorectal Polyps

Abstract

Convolutional Neural Networks (CNNs) are propelling advances in a range of different computer vision tasks such as object detection and object segmentation. Their success has motivated research in applications of such models for medical image analysis. If CNN-based models are to be helpful in a medical context, they need to be precise, interpretable, and uncertainty in predictions must be well understood. In this paper, we develop and evaluate recent advances in uncertainty estimation and model interpretability in the context of semantic segmentation of polyps from colonoscopy images. We evaluate and enhance several architectures of Fully Convolutional Networks (FCNs) for semantic segmentation of colorectal polyps and provide a comparison between these models. Our highest performing model achieves a 76.06\% mean IOU accuracy on the EndoScene dataset, a considerable improvement over the previous state-of-the-art.

arXiv commentTo appear in IEEE MLSP 2018

References in corpus (11)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Brain Tumor Segmentation with Deep Neural Networks
• What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Striving for Simplicity: The All Convolutional Net
• Confounding variables can degrade generalization performance of radiological deep learning models
• Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding
• BTS-DSN: Deeply Supervised Neural Network with Short Connections for Retinal Vessel Segmentation
• Cell Detection in Microscopy Images with Deep Convolutional Neural Network and Compressed Sensing

Cited by in corpus (23)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• Medical Image Segmentation Using Deep Learning: A Survey
• A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
• ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis
• Uncertainty-Aware Deep Ensembles for Reliable and Explainable Predictions of Clinical Time Series
• Real-time automatic polyp detection in colonoscopy using feature enhancement module and spatiotemporal similarity correlation unit
• Learning Uncertainty with Artificial Neural Networks for Improved Predictive Process Monitoring
• Time-Dynamic Estimates of the Reliability of Deep Semantic Segmentation Networks
• Double Encoder-Decoder Networks for Gastrointestinal Polyp Segmentation
• Uncertainty-weighted Loss Functions for Improved Adversarial Attacks on Semantic Segmentation
• Improving Video Instance Segmentation by Light-weight Temporal Uncertainty Estimates
• Shallow Attention Network for Polyp Segmentation
• Deep Bayesian segmentation for colon polyps: Well-calibrated predictions in medical imaging
• Enhanced U-Net: A Feature Enhancement Network for Polyp Segmentation
• A Hierarchical Multi-Task Approach to Gastrointestinal Image Analysis
• Frontiers in Intelligent Colonoscopy
• Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotations
• Temporal Uncertainty Localization to Enable Human-in-the-loop Analysis of Dynamic Contrast-enhanced Cardiac MRI Datasets
• SkiNet: A Deep Learning Solution for Skin Lesion Diagnosis with Uncertainty Estimation and Explainability
• Uncertainty Estimation in Deep 2D Echocardiography Segmentation
• CUAB: Convolutional Uncertainty Attention Block Enhanced the Chest X-ray Image Analysis