PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRI
arXiv:2204.11189 · doi:10.1109/JSTSP.2022.3170654
Abstract
Compressed Sensing MRI (CS-MRI) aims at reconstructing de-aliased images from sub-Nyquist sampling k-space data to accelerate MR Imaging, thus presenting two basic issues, i.e., where to sample and how to reconstruct. To deal with both problems simultaneously, we propose a novel end-to-end Probabilistic Under-sampling and Explicable Reconstruction neTwork, dubbed PUERT, to jointly optimize the sampling pattern and the reconstruction network. Instead of learning a deterministic mask, the proposed sampling subnet explores an optimal probabilistic sub-sampling pattern, which describes independent Bernoulli random variables at each possible sampling point, thus retaining robustness and stochastics for a more reliable CS reconstruction. A dynamic gradient estimation strategy is further introduced to gradually approximate the binarization function in backward propagation, which efficiently preserves the gradient information and further improves the reconstruction quality. Moreover, in our reconstruction subnet, we adopt a model-based network design scheme with high efficiency and interpretability, which is shown to assist in further exploitation for the sampling subnet. Extensive experiments on two widely used MRI datasets demonstrate that our proposed PUERT not only achieves state-of-the-art results in terms of both quantitative metrics and visual quality but also yields a sub-sampling pattern and a reconstruction model that are both customized to training data.
References in corpus (18)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- MoDL: Model Based Deep Learning Architecture for Inverse Problems
- Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Loss
- fastMRI: An Open Dataset and Benchmarks for Accelerated MRI
- Deep learning for undersampled MRI reconstruction
- RARE: Image Reconstruction using Deep Priors Learned without Ground Truth
- J-MoDL: Joint Model-Based Deep Learning for Optimized Sampling and Reconstruction
- Dense Recurrent Neural Networks for Accelerated MRI: History-Cognizant Unrolling of Optimization Algorithms
- Illumination Pattern Design with Deep Learning for Single-Shot Fourier Ptychographic Microscopy
- OEDIPUS: An Experiment Design Framework for Sparsity-Constrained MRI
- Self-Supervised Deep Active Accelerated MRI
- Convolutional neural networks that teach microscopes how to image
- Learning Sampling and Model-Based Signal Recovery for Compressed Sensing MRI
- Simulating single-coil MRI from the responses of multiple coils
- ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensing
- AI-based Reconstruction for Fast MRI -- A Systematic Review and Meta-analysis