Spatial-Spectral Fusion by Combining Deep Learning and Variation Model
arXiv:1809.00764 · doi:10.1109/TGRS.2019.2904659
Abstract
In the field of spatial-spectral fusion, the model-based method and the deep learning (DL)-based method are state-of-the-art. This paper presents a fusion method that incorporates the deep neural network into the model-based method for the most common case in the spatial-spectral fusion: PAN/multispectral (MS) fusion. Specifically, we first map the gradient of the high spatial resolution panchromatic image (HR-PAN) and the low spatial resolution multispectral image (LR-MS) to the gradient of the high spatial resolution multispectral image (HR-MS) via a deep residual convolutional neural network (CNN). Then we construct a fusion framework by the LR-MS image, the gradient prior learned from the gradient network, and the ideal fused image. Finally, an iterative optimization algorithm is used to solve the fusion model. Both quantitative and visual assessments on high-quality images from various sources demonstrate that the proposed fusion method is superior to all the mainstream algorithms included in the comparison in terms of overall fusion accuracy.
References in corpus (8)
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network
- Boosting the accuracy of multi-spectral image pan-sharpening by learning a deep residual network
- Estimating ground-level PM2.5 by fusing satellite and station observations: A geo-intelligent deep learning approach
- Missing Data Reconstruction in Remote Sensing image with a Unified Spatial-Temporal-Spectral Deep Convolutional Neural Network
- Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery
- Estimating regional ground-level PM2.5 directly from satellite top-of-atmosphere reflectance using deep learning
- Learning Deep CNN Denoiser Prior for Image Restoration