JotlasNet: Joint Tensor Low-Rank and Attention-based Sparse Unrolling Network for Accelerating Dynamic MRI

Abstract

Joint low-rank and sparse unrolling networks have shown superior performance in dynamic MRI reconstruction. However, existing works mainly utilized matrix low-rank priors, neglecting the tensor characteristics of dynamic MRI images, and only a global threshold is applied for the sparse constraint to the multi-channel data, limiting the flexibility of the network. Additionally, most of them have inherently complex network structure, with intricate interactions among variables. In this paper, we propose a novel deep unrolling network, JotlasNet, for dynamic MRI reconstruction by jointly utilizing tensor low-rank and attention-based sparse priors. Specifically, we utilize tensor low-rank prior to exploit the structural correlations in high-dimensional data. Convolutional neural networks are used to adaptively learn the low-rank and sparse transform domains. A novel attention-based soft thresholding operator is proposed to assign a unique learnable threshold to each channel of the data in the CNN-learned sparse domain. The network is unrolled from the elaborately designed composite splitting algorithm and thus features a simple yet efficient parallel structure. Extensive experiments on two datasets (OCMR, CMRxRecon) demonstrate the superior performance of JotlasNet in dynamic MRI reconstruction.

13 pages, 7 figures, accepted by Magnetic Resonance Imaging

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• ADADELTA: An Adaptive Learning Rate Method
• Fast Image Recovery Using Variable Splitting and Constrained Optimization
• MoDL: Model Based Deep Learning Architecture for Inverse Problems
• fastMRI: An Open Dataset and Benchmarks for Accelerated MRI
• Video-SwinUNet: Spatio-temporal Deep Learning Framework for VFSS Instance Segmentation
• FISTA-Net: Learning A Fast Iterative Shrinkage Thresholding Network for Inverse Problems in Imaging
• Results of the 2020 fastMRI Challenge for Machine Learning MR Image Reconstruction
• Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge
• A Proximal Decomposition Method for Solving Convex Variational Inverse Problems
• Robust Differentiable SVD
• HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction
• OCMR (v1.0)--Open-Access Multi-Coil k-Space Dataset for Cardiovascular Magnetic Resonance Imaging
• CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction