Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusion

Abstract

In the fields of image restoration and image fusion, model-driven methods and data-driven methods are the two representative frameworks. However, both approaches have their respective advantages and disadvantages. The model-driven methods consider the imaging mechanism, which is deterministic and theoretically reasonable; however, they cannot easily model complicated nonlinear problems. The data-driven methods have a stronger prior knowledge learning capability for huge data, especially for nonlinear statistical features; however, the interpretability of the networks is poor, and they are over-dependent on training data. In this paper, we systematically investigate the coupling of model-driven and data-driven methods, which has rarely been considered in the remote sensing image restoration and fusion communities. We are the first to summarize the coupling approaches into the following three categories: 1) data-driven and model-driven cascading methods; 2) variational models with embedded learning; and 3) model-constrained network learning methods. The typical existing and potential coupling methods for remote sensing image restoration and fusion are introduced with application examples. This paper also gives some new insights into the potential future directions, in terms of both methods and applications.

References in corpus (11)

• A Comprehensive Survey on Graph Neural Networks
• FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising
• Denoising Prior Driven Deep Neural Network for Image Restoration
• Boosting the accuracy of multi-spectral image pan-sharpening by learning a deep residual network
• Variational Denoising Network: Toward Blind Noise Modeling and Removal
• Deep Graph-Convolutional Image Denoising
• MuLoG, or How to apply Gaussian denoisers to multi-channel SAR speckle reduction?
• Cross-Scale Internal Graph Neural Network for Image Super-Resolution
• R-FUSE: Robust Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
• Spatial-Spectral Fusion by Combining Deep Learning and Variation Model
• Rank-One Network: An Effective Framework for Image Restoration

Cited by in corpus (3)

• A Multi-scale Generalized Shrinkage Threshold Network for Image Blind Deblurring in Remote Sensing
• A Single-Frame and Multi-Frame Cascaded Image Super-Resolution Method
• Task-Guided Prompting for Unified Remote Sensing Image Restoration