Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction

Abstract

Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last decades. The key ingredient to the problem is how to exploit the temporal correlation of the MR sequence to resolve the aliasing artefact. Traditionally, such observation led to a formulation of a non-convex optimisation problem, which were solved using iterative algorithms. Recently, however, deep learning based-approaches have gained significant popularity due to its ability to solve general inversion problems. In this work, we propose a unique, novel convolutional recurrent neural network (CRNN) architecture which reconstructs high quality cardiac MR images from highly undersampled k-space data by jointly exploiting the dependencies of the temporal sequences as well as the iterative nature of the traditional optimisation algorithms. In particular, the proposed architecture embeds the structure of the traditional iterative algorithms, efficiently modelling the recurrence of the iterative reconstruction stages by using recurrent hidden connections over such iterations. In addition, spatiotemporal dependencies are simultaneously learnt by exploiting bidirectional recurrent hidden connections across time sequences. The proposed algorithm is able to learn both the temporal dependency and the iterative reconstruction process effectively with only a very small number of parameters, while outperforming current MR reconstruction methods in terms of computational complexity, reconstruction accuracy and speed.

arXiv commentPublished in IEEE Transactions on Medical Imaging

References in corpus (6)

• DRAW: A Recurrent Neural Network For Image Generation
• Learning Deep CNN Denoiser Prior for Image Restoration
• Recurrent Attentional Networks for Saliency Detection
• Recurrent Generative Adversarial Networks for Proximal Learning and Automated Compressive Image Recovery
• Learning a Variational Network for Reconstruction of Accelerated MRI Data
• Deep artifact learning for compressed sensing and parallel MRI

Cited by in corpus (3)

• Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge
• Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Disease
• Stochastic Deep Compressive Sensing for the Reconstruction of Diffusion Tensor Cardiac MRI