Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery

Abstract

Deep neural networks have become increasingly popular for analyzing ECG data because of their ability to accurately identify cardiac conditions and hidden clinical factors. However, the lack of transparency due to the black box nature of these models is a common concern. To address this issue, explainable AI (XAI) methods can be employed. In this study, we present a comprehensive analysis of post-hoc XAI methods, investigating the local (attributions per sample) and global (based on domain expert concepts) perspectives. We have established a set of sanity checks to identify sensible attribution methods, and we provide quantitative evidence in accordance with expert rules. This dataset-wide analysis goes beyond anecdotal evidence by aggregating data across patient subgroups. Furthermore, we demonstrate how these XAI techniques can be utilized for knowledge discovery, such as identifying subtypes of myocardial infarction. We believe that these proposed methods can serve as building blocks for a complementary assessment of the internal validity during a certification process, as well as for knowledge discovery in the field of ECG analysis.

References in corpus (15)

• Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
• Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
• Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
• Deep neural networks can predict mortality from 12-lead electrocardiogram voltage data
• A Comprehensive Taxonomy for Explainable Artificial Intelligence: A Systematic Survey of Surveys on Methods and Concepts
• Self-supervised representation learning from 12-lead ECG data
• Detecting and interpreting myocardial infarction using fully convolutional neural networks
• From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation
• Explaining by Removing: A Unified Framework for Model Explanation
• Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteria
• Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAy
• Improving ECG Classification Interpretability using Saliency Maps
• Concept Activation Regions: A Generalized Framework For Concept-Based Explanations
• Multi-dimensional concept discovery (MCD): A unifying framework with completeness guarantees
• Using Deep Networks for Scientific Discovery in Physiological Signals

Cited by in corpus (3)

• Enhancing clinical decision support with physiological waveforms -- a multimodal benchmark in emergency care
• Generalizable deep learning for photoplethysmography-based blood pressure estimation -- A Benchmarking Study
• Abnormality Prediction and Forecasting of Laboratory Values from Electrocardiogram Signals Using Multimodal Deep Learning