Deep learning for cardiac image segmentation: A review

Abstract

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research.

Under review

References in corpus (19)

• A Survey on Deep Learning in Medical Image Analysis
• Deep Learning with Differential Privacy
• Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiography
• Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentation
• Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities
• Constrained-CNN losses for weakly supervised segmentation
• A Recurrent CNN for Automatic Detection and Classification of Coronary Artery Plaque and Stenosis in Coronary CT Angiography
• Automatic calcium scoring in low-dose chest CT using deep neural networks with dilated convolutions
• Deep learning cardiac motion analysis for human survival prediction
• Deep learning analysis of the myocardium in coronary CT angiography for identification of patients with functionally significant coronary artery stenosis
• Coronary Artery Centerline Extraction in Cardiac CT Angiography Using a CNN-Based Orientation Classifier
• Disentangled Representation Learning in Cardiac Image Analysis
• Direct Automatic Coronary Calcium Scoring in Cardiac and Chest CT
• ConvNet-Based Localization of Anatomical Structures in 3D Medical Images
• Learning-Based Quality Control for Cardiac MR Images
• Estimation of the volume of the left ventricle from MRI images using deep neural networks
• Fully Automatic Segmentation and Objective Assessment of Atrial Scars for Longstanding Persistent Atrial Fibrillation Patients Using Late Gadolinium-Enhanced MRI
• Factorised spatial representation learning: application in semi-supervised myocardial segmentation
• Domain and Geometry Agnostic CNNs for Left Atrium Segmentation in 3D Ultrasound

Cited by in corpus (36)

• Medical Image Segmentation Using Deep Learning: A Survey
• Modality specific U-Net variants for biomedical image segmentation: A survey
• A Study on the Use of Edge TPUs for Eye Fundus Image Segmentation
• A persistent homology-based topological loss for CNN-based multi-class segmentation of CMR
• Dehazing Ultrasound using Diffusion Models
• Energy efficiency in Edge TPU vs. embedded GPU for computer-aided medical imaging segmentation and classification
• A new method incorporating deep learning with shape priors for left ventricular segmentation in myocardial perfusion SPECT images
• Domain-incremental Cardiac Image Segmentation with Style-oriented Replay and Domain-sensitive Feature Whitening
• MMGL: Multi-Scale Multi-View Global-Local Contrastive learning for Semi-supervised Cardiac Image Segmentation
• Domain generalization in deep learning for contrast-enhanced imaging
• Assessment of Deep Learning Segmentation for Real-Time Free-Breathing Cardiac Magnetic Resonance Imaging at Rest and Under Exercise Stress
• Inverse Mechano-Electrical Reconstruction of Cardiac Excitation Wave Patterns from Mechanical Deformation using Deep Learning
• Image2Flow: A hybrid image and graph convolutional neural network for rapid patient-specific pulmonary artery segmentation and CFD flow field calculation from 3D cardiac MRI data
• Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation
• Exploring UMAP in hybrid models of entropy-based and representativeness sampling for active learning in biomedical segmentation
• Cardiac fat segmentation using computed tomography and an image-to-image conditional generative adversarial neural network
• FAS-UNet: A Novel FAS-driven Unet to Learn Variational Image Segmentation
• Evaluation of state-of-the-art deep learning models in the segmentation of the heart ventricles in parasternal short-axis echocardiograms
• Expanding the deep-learning model to diagnosis LVNC: Limitations and trade-offs
• Extreme Cardiac MRI Analysis under Respiratory Motion: Results of the CMRxMotion Challenge
• Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
• Artificial Intelligence-Based Image Reconstruction in Cardiac Magnetic Resonance
• A study of CNN capacity applied to Left Venticle Segmentation in Cardiac MRI
• Whole Heart 3D+T Representation Learning Through Sparse 2D Cardiac MR Images
• Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI
• Gaussian Process Emulators for Few-Shot Segmentation in Cardiac MRI
• LA-CaRe-CNN: Cascading Refinement CNN for Left Atrial Scar Segmentation
• U-R-VEDA: Integrating UNET, Residual Links, Edge and Dual Attention, and Vision Transformer for Accurate Semantic Segmentation of CMRs
• Estimation of mitral valve hinge point coordinates -- deep neural net for echocardiogram segmentation
• PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation
• Multi-Resolution Feature Fusion U-Net for Magnetic Resonance Imaging Segmentation
• Online learning in motion modeling for intra-interventional image sequences
• A method for supervoxel-wise association studies of age and other non-imaging variables from coronary computed tomography angiograms
• Human Perception-Inspired Grain Segmentation Refinement Using Conditional Random Fields
• Smoothness and continuity of cost functionals for ECG mismatch computation
• High-level Prior-based Loss Functions for Medical Image Segmentation: A Survey