A Survey of Sample-Efficient Deep Learning for Change Detection in Remote Sensing: Tasks, Strategies, and Challenges

Abstract

In the last decade, the rapid development of deep learning (DL) has made it possible to perform automatic, accurate, and robust Change Detection (CD) on large volumes of Remote Sensing Images (RSIs). However, despite advances in CD methods, their practical application in real-world contexts remains limited due to the diverse input data and the applicational context. For example, the collected RSIs can be time-series observations, and more informative results are required to indicate the time of change or the specific change category. Moreover, training a Deep Neural Network (DNN) requires a massive amount of training samples, whereas in many cases these samples are difficult to collect. To address these challenges, various specific CD methods have been developed considering different application scenarios and training resources. Additionally, recent advancements in image generation, self-supervision, and visual foundation models (VFMs) have opened up new approaches to address the 'data-hungry' issue of DL-based CD. The development of these methods in broader application scenarios requires further investigation and discussion. Therefore, this article summarizes the literature methods for different CD tasks and the available strategies and techniques to train and deploy DL-based CD methods in sample-limited scenarios. We expect that this survey can provide new insights and inspiration for researchers in this field to develop more effective CD methods that can be applied in a wider range of contexts.

Accepted in IEEE GRSM

References in corpus (18)

• PCANet: A Simple Deep Learning Baseline for Image Classification?
• Remote Sensing Image Change Detection with Transformers
• DASNet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images
• Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery
• Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images
• Changer: Feature Interaction is What You Need for Change Detection
• S2Looking: A Satellite Side-Looking Dataset for Building Change Detection
• Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images
• Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications
• Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection
• Adapting Segment Anything Model for Change Detection in HR Remote Sensing Images
• Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images
• Joint Spatio-Temporal Modeling for the Semantic Change Detection in Remote Sensing Images
• Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning
• CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding
• HyperNet: Self-Supervised Hyperspectral Spatial-Spectral Feature Understanding Network for Hyperspectral Change Detection
• C2F-SemiCD: A Coarse-to-Fine Semi-Supervised Change Detection Method Based on Consistency Regularization in High-Resolution Remote Sensing Images
• Weakly Supervised Change Detection Using Guided Anisotropic Difusion