Explainable artificial intelligence (XAI) in deep learning-based medical image analysis

Abstract

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial Intelligence (XAI) used in deep learning-based medical image analysis. A framework of XAI criteria is introduced to classify deep learning-based medical image analysis methods. Papers on XAI techniques in medical image analysis are then surveyed and categorized according to the framework and according to anatomical location. The paper concludes with an outlook of future opportunities for XAI in medical image analysis.

Submitted for publication. Comments welcome by email to first author

References in corpus (11)

• Towards A Rigorous Science of Interpretable Machine Learning
• Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
• Going Deeper through the Gleason Scoring Scale: An Automatic end-to-end System for Histology Prostate Grading and Cribriform Pattern Detection
• Dynamic Routing Between Capsules
• HMIC: Hierarchical Medical Image Classification, A Deep Learning Approach
• Neural Network Attributions: A Causal Perspective
• Intrapapillary Capillary Loop Classification in Magnification Endoscopy: Open Dataset and Baseline Methodology
• Regularizing Neural Network Training via Identity-wise Discriminative Feature Suppression
• Justifying Diagnosis Decisions by Deep Neural Networks
• Looking in the Right place for Anomalies: Explainable AI through Automatic Location Learning
• Deep Angular Embedding and Feature Correlation Attention for Breast MRI Cancer Analysis

Cited by in corpus (30)

• Explainable AI over the Internet of Things (IoT): Overview, State-of-the-Art and Future Directions
• Memory-aware curriculum federated learning for breast cancer classification
• Domain Generalization for Medical Image Analysis: A Review
• A scoping review on multimodal deep learning in biomedical images and texts
• Understanding Calibration of Deep Neural Networks for Medical Image Classification
• sMRI-PatchNet: A novel explainable patch-based deep learning network for Alzheimer's disease diagnosis and discriminative atrophy localisation with Structural MRI
• Weakly-supervised detection of AMD-related lesions in color fundus images using explainable deep learning
• Transfer Learning for the Efficient Detection of COVID-19 from Smartphone Audio Data
• Cross- and Intra-image Prototypical Learning for Multi-label Disease Diagnosis and Interpretation
• Unveiling the Human-like Similarities of Automatic Facial Expression Recognition: An Empirical Exploration through Explainable AI
• Clinical Domain Knowledge-Derived Template Improves Post Hoc AI Explanations in Pneumothorax Classification
• Cloud-based XAI Services for Assessing Open Repository Models Under Adversarial Attacks
• Towards consistency of rule-based explainer and black box model -- fusion of rule induction and XAI-based feature importance
• Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
• IODeep: an IOD for the introduction of deep learning in the DICOM standard
• EvalAttAI: A Holistic Approach to Evaluating Attribution Maps in Robust and Non-Robust Models
• Robust and Explainable Framework to Address Data Scarcity in Diagnostic Imaging
• Towards a Transparent and Interpretable AI Model for Medical Image Classifications
• The Explanation Necessity for Healthcare AI
• PhagoStat a scalable and interpretable end to end framework for efficient quantification of cell phagocytosis in neurodegenerative disease studies
• Understanding whole-body inter-personal dynamics between two players using neural Granger causality as the explainable AI (XAI)
• Reducing Annotation Need in Self-Explanatory Models for Lung Nodule Diagnosis
• Effective Predictive Modeling for Emergency Department Visits and Evaluating Exogenous Variables Impact: Using Explainable Meta-learning Gradient Boosting
• WEEP: A method for spatial interpretation of weakly supervised CNN models in computational pathology
• Meta-evaluating stability measures: MAX-Senstivity & AVG-Sensitivity
• Intuitive Axial Augmentation Using Polar-Sine-Based Piecewise Distortion for Medical Slice-Wise Segmentation
• A novel framework employing deep multi-attention channels network for the autonomous detection of metastasizing cells through fluorescence microscopy
• Federated Explainable Artificial Intelligence: Roles, Architectures, Evaluation, and Open Challenges
• CoPA: Hierarchical Concept Prompting and Aggregating Network for Explainable Diagnosis
• An explainable three dimension framework to uncover learning patterns: A unified look in variable sulci recognition