Echocardiography Segmentation with Enforced Temporal Consistency

Abstract

Convolutional neural networks (CNN) have demonstrated their ability to segment 2D cardiac ultrasound images. However, despite recent successes according to which the intra-observer variability on end-diastole and end-systole images has been reached, CNNs still struggle to leverage temporal information to provide accurate and temporally consistent segmentation maps across the whole cycle. Such consistency is required to accurately describe the cardiac function, a necessary step in diagnosing many cardiovascular diseases. In this paper, we propose a framework to learn the 2D+time apical long-axis cardiac shape such that the segmented sequences can benefit from temporal and anatomical consistency constraints. Our method is a post-processing that takes as input segmented echocardiographic sequences produced by any state-of-the-art method and processes it in two steps to (i) identify spatio-temporal inconsistencies according to the overall dynamics of the cardiac sequence and (ii) correct the inconsistencies. The identification and correction of cardiac inconsistencies relies on a constrained autoencoder trained to learn a physiologically interpretable embedding of cardiac shapes, where we can both detect and fix anomalies. We tested our framework on 98 full-cycle sequences from the CAMUS dataset, which are available alongside this paper. Our temporal regularization method not only improves the accuracy of the segmentation across the whole sequences, but also enforces temporal and anatomical consistency.

arXiv comment12 pages, accepted for publication in IEEE TMI

References in corpus (7)

• Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
• Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiography
• Disentangled Representation Learning in Cardiac Image Analysis
• Cardiac Segmentation with Strong Anatomical Guarantees
• A Tutorial on Dual Decomposition and Lagrangian Relaxation for Inference in Natural Language Processing
• Interpretable Deep Models for Cardiac Resynchronisation Therapy Response Prediction
• Temporal Consistency Objectives Regularize the Learning of Disentangled Representations