A Survey on Object Detection in Optical Remote Sensing Images

Abstract

Object detection in optical remote sensing images, being a fundamental but challenging problem in the field of aerial and satellite image analysis, plays an important role for a wide range of applications and is receiving significant attention in recent years. While enormous methods exist, a deep review of the literature concerning generic object detection is still lacking. This paper aims to provide a review of the recent progress in this field. Different from several previously published surveys that focus on a specific object class such as building and road, we concentrate on more generic object categories including, but are not limited to, road, building, tree, vehicle, ship, airport, urban-area. Covering about 270 publications we survey 1) template matching-based object detection methods, 2) knowledge-based object detection methods, 3) object-based image analysis (OBIA)-based object detection methods, 4) machine learning-based object detection methods, and 5) five publicly available datasets and three standard evaluation metrics. We also discuss the challenges of current studies and propose two promising research directions, namely deep learning-based feature representation and weakly supervised learning-based geospatial object detection. It is our hope that this survey will be beneficial for the researchers to have better understanding of this research field.

arXiv commentThis manuscript is the accepted version for ISPRS Journal of Photogrammetry and Remote Sensing

Cited by in corpus (64)

• Deep learning in remote sensing: a review
• Remote Sensing Image Scene Classification: Benchmark and State of the Art
• Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark
• AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classification
• A Survey of Deep Learning-based Object Detection
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Towards Large-Scale Small Object Detection: Survey and Benchmarks
• A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
• Object Detection in 20 Years: A Survey
• CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery
• A Review on Deep Learning in UAV Remote Sensing
• Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images
• Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network
• R${}^2$-CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images
• ORSIm Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features
• Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training for Road Segmentation of Remote Sensing Images
• Few-shot Object Detection on Remote Sensing Images
• Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection
• Multi-Granularity Canonical Appearance Pooling for Remote Sensing Scene Classification
• R${}^3$-Net: A Deep Network for Multi-oriented Vehicle Detection in Aerial Images and Videos
• Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
• Roofpedia: Automatic mapping of green and solar roofs for an open roofscape registry and evaluation of urban sustainability
• Machine learning based hyperspectral image analysis: A survey
• CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding
• Arbitrary-Oriented Ship Detection through Center-Head Point Extraction
• Oriented Bounding Boxes for Small and Freely Rotated Objects
• From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Data
• Satellite Imagery Multiscale Rapid Detection with Windowed Networks
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• One-Two-One Networks for Compression Artifacts Reduction in Remote Sensing
• Automatic Prediction of Building Age from Photographs
• Oriented object detection in optical remote sensing images using deep learning: a survey
• A framework for remote sensing images processing using deep learning technique
• There Are No Data Like More Data- Datasets for Deep Learning in Earth Observation
• Online Structured Sparsity-based Moving Object Detection from Satellite Videos
• Benchmark Dataset for Automatic Damaged Building Detection from Post-Hurricane Remotely Sensed Imagery
• Faster Bounding Box Annotation for Object Detection in Indoor Scenes
• Embedded Self-Distillation in Compact Multi-Branch Ensemble Network for Remote Sensing Scene Classification
• A benchmark dataset for deep learning-based airplane detection: HRPlanes
• Density Weighted Connectivity of Grass Pixels in Image Frames for Biomass Estimation
• Deep Adaptive Proposal Network for Object Detection in Optical Remote Sensing Images
• FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagery
• A Survey on Deep Domain Adaptation and Tiny Object Detection Challenges, Techniques and Datasets
• SatImNet: Structured and Harmonised Training Data for Enhanced Satellite Imagery Classification
• Aerial Imagery Pixel-level Segmentation
• On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID
• Deep Multiple Instance Learning for Airplane Detection in High Resolution Imagery
• A block-based inter-band predictor using multilayer propagation neural network for hyperspectral image compression
• Detecting Environmental Violations with Satellite Imagery in Near Real Time: Land Application under the Clean Water Act
• DeepSWIR: A Deep Learning Based Approach for the Synthesis of Short-Wave InfraRed Band using Multi-Sensor Concurrent Datasets
• Discovering Characteristic Landmarks on Ancient Coins using Convolutional Networks
• BD-MSA: Body decouple VHR Remote Sensing Image Change Detection method guided by multi-scale feature information aggregation
• Applying physics-based loss functions to neural networks for improved generalizability in mechanics problems
• Airplane Detection Based on Mask Region Convolution Neural Network
• A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer
• Learning Orientation-Estimation Convolutional Neural Network for Building Detection in Optical Remote Sensing Image
• Robust object extraction from remote sensing data
• A Comprehensive Survey of Navigation Systems for the Visual Impaired
• Beyond Spatial Auto-Regressive Models: Predicting Housing Prices with Satellite Imagery
• Domain Adaptive Generation of Aircraft on Satellite Imagery via Simulated and Unsupervised Learning
• Airplane Type Identification Based on Mask RCNN and Drone Images
• Multi-patch Feature Pyramid Network for Weakly Supervised Object Detection in Optical Remote Sensing Images
• Predicting Ground-Level Scene Layout from Aerial Imagery
• All-Weather Object Recognition Using Radar and Infrared Sensing