Continuous Cross-resolution Remote Sensing Image Change Detection

Abstract

Most contemporary supervised Remote Sensing (RS) image Change Detection (CD) approaches are customized for equal-resolution bitemporal images. Real-world applications raise the need for cross-resolution change detection, aka, CD based on bitemporal images with different spatial resolutions. Given training samples of a fixed bitemporal resolution difference (ratio) between the high-resolution (HR) image and the low-resolution (LR) one, current cross-resolution methods may fit a certain ratio but lack adaptation to other resolution differences. Toward continuous cross-resolution CD, we propose scale-invariant learning to enforce the model consistently predicting HR results given synthesized samples of varying resolution differences. Concretely, we synthesize blurred versions of the HR image by random downsampled reconstructions to reduce the gap between HR and LR images. We introduce coordinate-based representations to decode per-pixel predictions by feeding the coordinate query and corresponding multi-level embedding features into an MLP that implicitly learns the shape of land cover changes, therefore benefiting recognizing blurred objects in the LR image. Moreover, considering that spatial resolution mainly affects the local textures, we apply local-window self-attention to align bitemporal features during the early stages of the encoder. Extensive experiments on two synthesized and one real-world different-resolution CD datasets verify the effectiveness of the proposed method. Our method significantly outperforms several vanilla CD methods and two cross-resolution CD methods on the three datasets both in in-distribution and out-of-distribution settings. The empirical results suggest that our method could yield relatively consistent HR change predictions regardless of varying bitemporal resolution ratios. Our code is available at \url{https://github.com/justchenhao/SILI_CD}.

arXiv comment21 pages, 11 figures. Accepted article by IEEE TGRS

References in corpus (13)

• Remote Sensing Image Change Detection with Transformers
• DASNet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images
• Changer: Feature Interaction is What You Need for Change Detection
• Super-resolution-based Change Detection Network with Stacked Attention Module for Images with Different Resolutions
• From W-Net to CDGAN: Bi-temporal Change Detection via Deep Learning Techniques
• Building Damage Detection in Satellite Imagery Using Convolutional Neural Networks
• Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Space
• Semantic-aware Dense Representation Learning for Remote Sensing Image Change Detection
• UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolution
• SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observation
• Remote Sensing Novel View Synthesis with Implicit Multiplane Representations
• Implicit Ray-Transformers for Multi-view Remote Sensing Image Segmentation
• IDAN: Image Difference Attention Network for Change Detection

Cited by in corpus (2)

• AdaSemiCD: An Adaptive Semi-Supervised Change Detection Method Based on Pseudo-Label Evaluation
• NN-Copula-CD: A Copula-Guided Interpretable Neural Network for Change Detection in Heterogeneous Remote Sensing Images