Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges

Abstract

In the past decade, object detection has achieved significant progress in natural images but not in aerial images, due to the massive variations in the scale and orientation of objects caused by the bird's-eye view of aerial images. More importantly, the lack of large-scale benchmarks has become a major obstacle to the development of object detection in aerial images (ODAI). In this paper,we present a large-scale Dataset of Object deTection in Aerial images (DOTA) and comprehensive baselines for ODAI. The proposed DOTA dataset contains 1,793,658 object instances of 18 categories of oriented-bounding-box annotations collected from 11,268 aerial images. Based on this large-scale and well-annotated dataset, we build baselines covering 10 state-of-the-art algorithms with over 70 configurations, where the speed and accuracy performances of each model have been evaluated. Furthermore, we provide a code library for ODAI and build a website for evaluating different algorithms. Previous challenges run on DOTA have attracted more than 1300 teams worldwide. We believe that the expanded large-scale DOTA dataset, the extensive baselines, the code library and the challenges can facilitate the designs of robust algorithms and reproducible research on the problem of object detection in aerial images.

arXiv commentAccepted to IEEE TPAMI

References in corpus (17)

• Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark
• AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classification
• Arbitrary-Oriented Scene Text Detection via Rotation Proposals
• Gliding vertex on the horizontal bounding box for multi-oriented object detection
• TextBoxes++: A Single-Shot Oriented Scene Text Detector
• MMDetection: Open MMLab Detection Toolbox and Benchmark
• Deformable Convolutional Networks
• The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale
• Vision Meets Drones: A Challenge
• Light-Head R-CNN: In Defense of Two-Stage Object Detector
• R${}^2$-CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images
• Adaptive Period Embedding for Representing Oriented Objects in Aerial Images
• SpaceNet MVOI: a Multi-View Overhead Imagery Dataset
• xView: Objects in Context in Overhead Imagery
• FGSD: A Dataset for Fine-Grained Ship Detection in High Resolution Satellite Images
• Align Deep Features for Oriented Object Detection
• RarePlanes: Synthetic Data Takes Flight

Cited by in corpus (12)

• Towards Large-Scale Small Object Detection: Survey and Benchmarks
• Fewer is More: Efficient Object Detection in Large Aerial Images
• Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works
• AI Security for Geoscience and Remote Sensing: Challenges and Future Trends
• All Grains, One Scheme (AGOS): Learning Multi-grain Instance Representation for Aerial Scene Classification
• Hidden Path Selection Network for Semantic Segmentation of Remote Sensing Images
• MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detection
• Backdoor Attacks for Remote Sensing Data with Wavelet Transform
• Archangel: A Hybrid UAV-based Human Detection Benchmark with Position and Pose Metadata
• Oriented RepPoints for Aerial Object Detection
• On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances and Million-AID
• Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images