Memory-Augmented Deep Unfolding Network for Compressive Sensing

Abstract

Mapping a truncated optimization method into a deep neural network, deep unfolding network (DUN) has attracted growing attention in compressive sensing (CS) due to its good interpretability and high performance. Each stage in DUNs corresponds to one iteration in optimization. By understanding DUNs from the perspective of the human brain's memory processing, we find there exists two issues in existing DUNs. One is the information between every two adjacent stages, which can be regarded as short-term memory, is usually lost seriously. The other is no explicit mechanism to ensure that the previous stages affect the current stage, which means memory is easily forgotten. To solve these issues, in this paper, a novel DUN with persistent memory for CS is proposed, dubbed Memory-Augmented Deep Unfolding Network (MADUN). We design a memory-augmented proximal mapping module (MAPMM) by combining two types of memory augmentation mechanisms, namely High-throughput Short-term Memory (HSM) and Cross-stage Long-term Memory (CLM). HSM is exploited to allow DUNs to transmit multi-channel short-term memory, which greatly reduces information loss between adjacent stages. CLM is utilized to develop the dependency of deep information across cascading stages, which greatly enhances network representation capability. Extensive CS experiments on natural and MR images show that with the strong ability to maintain and balance information our MADUN outperforms existing state-of-the-art methods by a large margin. The source code is available at https://github.com/jianzhangcs/MADUN/.

10 pages, 7 figures, ACM MM 2021

References in corpus (11)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
• MoDL: Model Based Deep Learning Architecture for Inverse Problems
• Denoising Prior Driven Deep Neural Network for Image Restoration
• Deep learning for undersampled MRI reconstruction
• A Deep Learning Approach to Structured Signal Recovery
• Compressed Sensing for Energy-Efficient Wireless Telemonitoring of Noninvasive Fetal ECG via Block Sparse Bayesian Learning
• AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensing
• Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium
• Image Compressive Sensing Recovery Using Adaptively Learned Sparsifying Basis via L0 Minimization
• COAST: COntrollable Arbitrary-Sampling NeTwork for Compressive Sensing

Cited by in corpus (6)

• Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensing
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction
• Deep Unfolding Multi-modal Image Fusion Network via Attribution Analysis
• Fast Hierarchical Deep Unfolding Network for Image Compressed Sensing
• A Compound Gaussian Least Squares Algorithm and Unrolled Network for Linear Inverse Problems
• WTDUN: Wavelet Tree-Structured Sampling and Deep Unfolding Network for Image Compressed Sensing