Image Compressed Sensing Using Non-local Neural Network
arXiv:2112.03712 · doi:10.1109/TMM.2021.3132489
Abstract
Deep network-based image Compressed Sensing (CS) has attracted much attention in recent years. However, the existing deep network-based CS schemes either reconstruct the target image in a block-by-block manner that leads to serious block artifacts or train the deep network as a black box that brings about limited insights of image prior knowledge. In this paper, a novel image CS framework using non-local neural network (NL-CSNet) is proposed, which utilizes the non-local self-similarity priors with deep network to improve the reconstruction quality. In the proposed NL-CSNet, two non-local subnetworks are constructed for utilizing the non-local self-similarity priors in the measurement domain and the multi-scale feature domain respectively. Specifically, in the subnetwork of measurement domain, the long-distance dependencies between the measurements of different image blocks are established for better initial reconstruction. Analogically, in the subnetwork of multi-scale feature domain, the affinities between the dense feature representations are explored in the multi-scale space for deep reconstruction. Furthermore, a novel loss function is developed to enhance the coupling between the non-local representations, which also enables an end-to-end training of NL-CSNet. Extensive experiments manifest that NL-CSNet outperforms existing state-of-the-art CS methods, while maintaining fast computational speed.
arXiv comment14 pages, 11 figures, 7 tables
References in corpus (15)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Message Passing Algorithms for Compressed Sensing
- Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
- Model-Based Compressive Sensing
- Deep Image Prior
- Denoising Prior Driven Deep Neural Network for Image Restoration
- DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing
- A Deep Learning Approach to Structured Signal Recovery
- AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensing
- RARE: Image Reconstruction using Deep Priors Learned without Ground Truth
- Compact Generalized Non-local Network
- Cross-Scale Internal Graph Neural Network for Image Super-Resolution
- Analysis of Regularized LS Reconstruction and Random Matrix Ensembles in Compressed Sensing
- Residual Conv-Deconv Grid Network for Semantic Segmentation