DR$|$GRADUATE: uncertainty-aware deep learning-based diabetic retinopathy grading in eye fundus images

Abstract

Diabetic retinopathy (DR) grading is crucial in determining the adequate treatment and follow up of patients, but the screening process can be tiresome and prone to errors. Deep learning approaches have shown promising performance as computer-aided diagnosis(CAD) systems, but their black-box behaviour hinders the clinical application. We propose DR$|$GRADUATE, a novel deep learning-based DR grading CAD system that supports its decision by providing a medically interpretable explanation and an estimation of how uncertain that prediction is, allowing the ophthalmologist to measure how much that decision should be trusted. We designed DR$|$GRADUATE taking into account the ordinal nature of the DR grading problem. A novel Gaussian-sampling approach built upon a Multiple Instance Learning framework allow DR$|$GRADUATE to infer an image grade associated with an explanation map and a prediction uncertainty while being trained only with image-wise labels. DR$|$GRADUATE was trained on the Kaggle training set and evaluated across multiple datasets. In DR grading, a quadratic-weighted Cohen's kappa (QWK) between 0.71 and 0.84 was achieved in five different datasets. We show that high QWK values occur for images with low prediction uncertainty, thus indicating that this uncertainty is a valid measure of the predictions' quality. Further, bad quality images are generally associated with higher uncertainties, showing that images not suitable for diagnosis indeed lead to less trustworthy predictions. Additionally, tests on unfamiliar medical image data types suggest that DR$|$GRADUATE allows outlier detection. The attention maps generally highlight regions of interest for diagnosis. These results show the great potential of DR$|$GRADUATE as a second-opinion system in DR severity grading.

Published at Medical Image Analysis (Elsevier). Publication licensed under the Creative Commons CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. Figures are compressed due to file size constraints

References in corpus (5)

• A systematic study of the class imbalance problem in convolutional neural networks
• What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
• Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy
• Deep image mining for diabetic retinopathy screening
• A Deep Learning Interpretable Classifier for Diabetic Retinopathy Disease Grading

Cited by in corpus (16)

• A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges
• Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
• A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
• A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications
• ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosis
• QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results
• Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning
• DONet: Dual Objective Networks for Skin Lesion Segmentation
• Balanced-MixUp for Highly Imbalanced Medical Image Classification
• Unimodal Distributions for Ordinal Regression
• Applications of Deep Learning in Fundus Images: A Review
• Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognition
• Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosis
• An Efficient Framework for Automated Screening of Clinically Significant Macular Edema