RarePlanes: Synthetic Data Takes Flight
arXiv:2006.02963
Abstract
RarePlanes is a unique open-source machine learning dataset that incorporates both real and synthetically generated satellite imagery. The RarePlanes dataset specifically focuses on the value of synthetic data to aid computer vision algorithms in their ability to automatically detect aircraft and their attributes in satellite imagery. Although other synthetic/real combination datasets exist, RarePlanes is the largest openly-available very-high resolution dataset built to test the value of synthetic data from an overhead perspective. Previous research has shown that synthetic data can reduce the amount of real training data needed and potentially improve performance for many tasks in the computer vision domain. The real portion of the dataset consists of 253 Maxar WorldView-3 satellite scenes spanning 112 locations and 2,142 km^2 with 14,700 hand-annotated aircraft. The accompanying synthetic dataset is generated via AI.Reverie's simulation platform and features 50,000 synthetic satellite images simulating a total area of 9331.2 km^2 with ~630,000 aircraft annotations. Both the real and synthetically generated aircraft feature 10 fine grain attributes including: aircraft length, wingspan, wing-shape, wing-position, wingspan class, propulsion, number of engines, number of vertical-stabilizers, presence of canards, and aircraft role. Finally, we conduct extensive experiments to evaluate the real and synthetic datasets and compare performances. By doing so, we show the value of synthetic data for the task of detecting and classifying aircraft from an overhead perspective.
arXiv commentTo appear in WACV 2021 - 11 pages
References in corpus (22)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Deep Residual Learning for Image Recognition
- ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation
- TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation
- SpaceNet: A Remote Sensing Dataset and Challenge Series
- Matterport3D: Learning from RGB-D Data in Indoor Environments
- Virtual Worlds as Proxy for Multi-Object Tracking Analysis
- Domain Adaptation for Visual Applications: A Comprehensive Survey
- You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery
- What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?
- iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images
- SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects
- SpaceNet MVOI: a Multi-View Overhead Imagery Dataset
- xView: Objects in Context in Overhead Imagery
- Deep Leaf Segmentation Using Synthetic Data
- Training Deep Face Recognition Systems with Synthetic Data
- Object Detection Using Deep CNNs Trained on Synthetic Images
- Recent Advances in Zero-shot Recognition
- A New Stereo Benchmarking Dataset for Satellite Images
- Learning to Interpret Satellite Images in Global Scale Using Wikipedia
- SpaceNet 6: Multi-Sensor All Weather Mapping Dataset
- Can Synthetic Faces Undo the Damage of Dataset Bias to Face Recognition and Facial Landmark Detection?