Explaining Deep Learning for ECG Analysis: Building Blocks for Auditing and Knowledge Discovery

Abstract

Deep neural networks have become increasingly popular for analyzing ECG data because of their ability to accurately identify cardiac conditions and hidden clinical factors. However, the lack of transparency due to the black box nature of these models is a common concern. To address this issue, explainable AI (XAI) methods can be employed. In this study, we present a comprehensive analysis of post-hoc XAI methods, investigating the local (attributions per sample) and global (based on domain expert concepts) perspectives. We have established a set of sanity checks to identify sensible attribution methods, and we provide quantitative evidence in accordance with expert rules. This dataset-wide analysis goes beyond anecdotal evidence by aggregating data across patient subgroups. Furthermore, we demonstrate how these XAI techniques can be utilized for knowledge discovery, such as identifying subtypes of myocardial infarction. We believe that these proposed methods can serve as building blocks for a complementary assessment of the internal validity during a certification process, as well as for knowledge discovery in the field of ECG analysis.

References in corpus (7)

• Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
• From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation
• Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteria
• Improving ECG Classification Interpretability using Saliency Maps
• Concept Activation Regions: A Generalized Framework For Concept-Based Explanations
• Multi-dimensional concept discovery (MCD): A unifying framework with completeness guarantees
• Using Deep Networks for Scientific Discovery in Physiological Signals

Cited by in corpus (3)

• Enhancing clinical decision support with physiological waveforms -- a multimodal benchmark in emergency care
• Generalizable deep learning for photoplethysmography-based blood pressure estimation -- A Benchmarking Study
• Abnormality Prediction and Forecasting of Laboratory Values from Electrocardiogram Signals Using Multimodal Deep Learning