Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark

Abstract

Substantial efforts have been devoted more recently to presenting various methods for object detection in optical remote sensing images. However, the current survey of datasets and deep learning based methods for object detection in optical remote sensing images is not adequate. Moreover, most of the existing datasets have some shortcomings, for example, the numbers of images and object categories are small scale, and the image diversity and variations are insufficient. These limitations greatly affect the development of deep learning based object detection methods. In the paper, we provide a comprehensive review of the recent deep learning based object detection progress in both the computer vision and earth observation communities. Then, we propose a large-scale, publicly available benchmark for object DetectIon in Optical Remote sensing images, which we name as DIOR. The dataset contains 23463 images and 192472 instances, covering 20 object classes. The proposed DIOR dataset 1) is large-scale on the object categories, on the object instance number, and on the total image number; 2) has a large range of object size variations, not only in terms of spatial resolutions, but also in the aspect of inter- and intra-class size variability across objects; 3) holds big variations as the images are obtained with different imaging conditions, weathers, seasons, and image quality; and 4) has high inter-class similarity and intra-class diversity. The proposed benchmark can help the researchers to develop and validate their data-driven methods. Finally, we evaluate several state-of-the-art approaches on our DIOR dataset to establish a baseline for future research.

References in corpus (21)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• TensorFlow: A system for large-scale machine learning
• YOLOv3: An Incremental Improvement
• Caffe: Convolutional Architecture for Fast Feature Embedding
• R-FCN: Object Detection via Region-based Fully Convolutional Networks
• Deep learning in remote sensing: a review
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
• Fully Convolutional Networks for Semantic Segmentation
• Squeeze-and-Excitation Networks
• DSSD : Deconvolutional Single Shot Detector
• A Survey on Object Detection in Optical Remote Sensing Images
• Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
• Gabor Convolutional Networks
• Light-Head R-CNN: In Defense of Two-Stage Object Detector
• Deep Learning for Generic Object Detection: A Survey
• Learning a Rotation Invariant Detector with Rotatable Bounding Box
• SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
• Receptive Field Block Net for Accurate and Fast Object Detection
• Recent Advances in Object Detection in the Age of Deep Convolutional Neural Networks
• Deep Adaptive Proposal Network for Object Detection in Optical Remote Sensing Images

Cited by in corpus (61)

• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
• Towards Large-Scale Small Object Detection: Survey and Benchmarks
• Anchor-free Oriented Proposal Generator for Object Detection
• Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark
• Deep Learning for UAV-based Object Detection and Tracking: A Survey
• CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Images
• Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Art
• An Empirical Study of Remote Sensing Pretraining
• RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Data
• A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detection
• Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmark
• Few-shot Object Detection on Remote Sensing Images
• ARS-DETR: Aspect Ratio-Sensitive Detection Transformer for Aerial Oriented Object Detection
• Fewer is More: Efficient Object Detection in Large Aerial Images
• Small Object Detection: A Comprehensive Survey on Challenges, Techniques and Real-World Applications
• Deep Nearest Neighbor Anomaly Detection
• CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding
• Unsupervised domain adaptation semantic segmentation of high-resolution remote sensing imagery with invariant domain-level prototype memory
• Oriented Bounding Boxes for Small and Freely Rotated Objects
• From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Data
• LO-Det: Lightweight Oriented Object Detection in Remote Sensing Images
• Counting from Sky: A Large-scale Dataset for Remote Sensing Object Counting and A Benchmark Method
• UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
• Learning Modulated Loss for Rotated Object Detection
• A Systematic IoU-Related Method: Beyond Simplified Regression for Better Localization
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• Guided Hybrid Quantization for Object detection in Multimodal Remote Sensing Imagery via One-to-one Self-teaching
• PETDet: Proposal Enhancement for Two-Stage Fine-Grained Object Detection
• Oriented object detection in optical remote sensing images using deep learning: a survey
• There Are No Data Like More Data- Datasets for Deep Learning in Earth Observation
• Transformation-Invariant Network for Few-Shot Object Detection in Remote Sensing Images
• Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
• Task-wise Sampling Convolutions for Arbitrary-Oriented Object Detection in Aerial Images
• False: False Negative Samples Aware Contrastive Learning for Semantic Segmentation of High-Resolution Remote Sensing Image
• A benchmark dataset for deep learning-based airplane detection: HRPlanes
• Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
• Multi-Grained Angle Representation for Remote Sensing Object Detection
• Adaptive Self-Training for Object Detection
• Panoptic Perception: A Novel Task and Fine-grained Dataset for Universal Remote Sensing Image Interpretation
• Boosting Semi-Supervised Object Detection in Remote Sensing Images With Active Teaching
• On the Robustness of Object Detection Models on Aerial Images
• OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery
• Oriented RepPoints for Aerial Object Detection
• FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagery
• SAM2-ELNet: Label Enhancement and Automatic Annotation for Remote Sensing Segmentation
• VME: A Satellite Imagery Dataset and Benchmark for Detecting Vehicles in the Middle East and Beyond
• A Temporal-Spectral Fusion Transformer with Subject-Specific Adapter for Enhancing RSVP-BCI Decoding
• On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID
• Can Synthetic Data Improve Object Detection Results for Remote Sensing Images?
• Exploring EEG and Eye Movement Fusion for Multi-Class Target RSVP-BCI
• MSSDF: Modality-Shared Self-supervised Distillation for High-Resolution Multi-modal Remote Sensing Image Learning
• Oriented R-CNN for Object Detection
• RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images
• Diverse Instance Generation via Diffusion Models for Enhanced Few-Shot Object Detection in Remote Sensing Images
• Dual-Stream Spectral Decoupling Distillation for Remote Sensing Object Detection
• Object-Based Augmentation Improves Quality of Remote Sensing Semantic Segmentation
• The MIS Check-Dam Dataset for Object Detection and Instance Segmentation Tasks
• Optimizing Data Processing in Space for Object Detection in Satellite Imagery
• Learning Oriented Remote Sensing Object Detection via Naive Geometric Computing
• Mask Clustering-based Annotation Engine for Large-Scale Submeter Land Cover Mapping