ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis

Abstract

In recent years, Artificial Intelligence (AI) has proven its relevance for medical decision support. However, the "black-box" nature of successful AI algorithms still holds back their wide-spread deployment. In this paper, we describe an eXplanatory Artificial Intelligence (XAI) that reaches the same level of performance as black-box AI, for the task of classifying Diabetic Retinopathy (DR) severity using Color Fundus Photography (CFP). This algorithm, called ExplAIn, learns to segment and categorize lesions in images; the final image-level classification directly derives from these multivariate lesion segmentations. The novelty of this explanatory framework is that it is trained from end to end, with image supervision only, just like black-box AI algorithms: the concepts of lesions and lesion categories emerge by themselves. For improved lesion localization, foreground/background separation is trained through self-supervision, in such a way that occluding foreground pixels transforms the input image into a healthy-looking image. The advantage of such an architecture is that automatic diagnoses can be explained simply by an image and/or a few sentences. ExplAIn is evaluated at the image level and at the pixel level on various CFP image datasets. We expect this new framework, which jointly offers high classification performance and explainability, to facilitate AI deployment.

References in corpus (10)

• European Union regulations on algorithmic decision-making and a "right to explanation"
• Deep image mining for diabetic retinopathy screening
• Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation
• Constrained-CNN losses for weakly supervised segmentation
• Distilling a Neural Network Into a Soft Decision Tree
• Uncertainty and Interpretability in Convolutional Neural Networks for Semantic Segmentation of Colorectal Polyps
• DR$|$GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images
• Deep Neural Decision Trees
• Self-supervised Scale Equivariant Network for Weakly Supervised Semantic Segmentation
• Instant automatic diagnosis of diabetic retinopathy

Cited by in corpus (6)

• Exploring Variational Auto-Encoder Architectures, Configurations, and Datasets for Generative Music Explainable AI
• Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images
• DISCOVER: 2-D Multiview Summarization of Optical Coherence Tomography Angiography for Automatic Diabetic Retinopathy Diagnosis
• XAIxArts Manifesto: Explainable AI for the Arts
• A novel framework employing deep multi-attention channels network for the autonomous detection of metastasizing cells through fluorescence microscopy
• An explainable three dimension framework to uncover learning patterns: A unified look in variable sulci recognition