Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives

Abstract

In recent years, supervised learning has been widely used in various tasks of optical remote sensing image understanding, including remote sensing image classification, pixel-wise segmentation, change detection, and object detection. The methods based on supervised learning need a large amount of high-quality training data and their performance highly depends on the quality of the labels. However, in practical remote sensing applications, it is often expensive and time-consuming to obtain large-scale data sets with high-quality labels, which leads to a lack of sufficient supervised information. In some cases, only coarse-grained labels can be obtained, resulting in the lack of exact supervision. In addition, the supervised information obtained manually may be wrong, resulting in a lack of accurate supervision. Therefore, remote sensing image understanding often faces the problems of incomplete, inexact, and inaccurate supervised information, which will affect the breadth and depth of remote sensing applications. In order to solve the above-mentioned problems, researchers have explored various tasks in remote sensing image understanding under weak supervision. This paper summarizes the research progress of weakly supervised learning in the field of remote sensing, including three typical weakly supervised paradigms: 1) Incomplete supervision, where only a subset of training data is labeled; 2) Inexact supervision, where only coarse-grained labels of training data are given; 3) Inaccurate supervision, where the labels given are not always true on the ground.

References in corpus (17)

• TensorFlow: A system for large-scale machine learning
• Deep learning in remote sensing: a review
• Deep Learning for Hyperspectral Image Classification: An Overview
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Deep Learning for Classification of Hyperspectral Data: A Comparative Review
• Cost-Effective Active Learning for Deep Image Classification
• A survey of active learning algorithms for supervised remote sensing image classification
• Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• Machine Learning Information Fusion in Earth Observation: A Comprehensive Review of Methods, Applications and Data Sources
• Hyperspectral Image Classification in the Presence of Noisy Labels
• Active Transfer Learning Network: A Unified Deep Joint Spectral-Spatial Feature Learning Model For Hyperspectral Image Classification
• Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learning
• Crowdsourcing Dialect Characterization through Twitter
• Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification
• Learning Noise Transition Matrix from Only Noisy Labels via Total Variation Regularization
• Deep Learning for Weakly-Supervised Object Detection and Object Localization: A Survey

Cited by in corpus (4)

• SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models
• Auto-Prompting SAM for Weakly Supervised Landslide Extraction
• LiDAR Remote Sensing Meets Weak Supervision: Concepts, Methods, and Perspectives
• ULF: Unsupervised Labeling Function Correction using Cross-Validation for Weak Supervision