Geographical Knowledge-driven Representation Learning for Remote Sensing Images
arXiv:2107.05276 · doi:10.1109/TGRS.2021.3115569
Abstract
The proliferation of remote sensing satellites has resulted in a massive amount of remote sensing images. However, due to human and material resource constraints, the vast majority of remote sensing images remain unlabeled. As a result, it cannot be applied to currently available deep learning methods. To fully utilize the remaining unlabeled images, we propose a Geographical Knowledge-driven Representation learning method for remote sensing images (GeoKR), improving network performance and reduce the demand for annotated data. The global land cover products and geographical location associated with each remote sensing image are regarded as geographical knowledge to provide supervision for representation learning and network pre-training. An efficient pre-training framework is proposed to eliminate the supervision noises caused by imaging times and resolutions difference between remote sensing images and geographical knowledge. A large scale pre-training dataset Levir-KR is proposed to support network pre-training. It contains 1,431,950 remote sensing images from Gaofen series satellites with various resolutions. Experimental results demonstrate that our proposed method outperforms ImageNet pre-training and self-supervised representation learning methods and significantly reduces the burden of data annotation on downstream tasks such as scene classification, semantic segmentation, object detection, and cloud / snow detection. It demonstrates that our proposed method can be used as a novel paradigm for pre-training neural networks. Codes will be available on https://github.com/flyakon/Geographical-Knowledge-driven-Representaion-Learning.
arXiv comment13 pages, 5 figures
References in corpus (15)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Scikit-learn: Machine Learning in Python
- A Simple Framework for Contrastive Learning of Visual Representations
- Bootstrap your own latent: A new approach to self-supervised Learning
- ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data
- Improved Baselines with Momentum Contrastive Learning
- Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
- Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
- Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery using Deep Learning
- Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep (Overview and Toolbox)
- Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
- Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors
- Selfie: Self-supervised Pretraining for Image Embedding
- Automatic Shortcut Removal for Self-Supervised Representation Learning
- Learning Latent Representations in Neural Networks for Clustering through Pseudo Supervision and Graph-based Activity Regularization