Artificial and beneficial -- Exploiting artificial images for aerial vehicle detection
arXiv:2104.03054 · doi:10.1016/j.isprsjprs.2021.02.015
Abstract
Object detection in aerial images is an important task in environmental, economic, and infrastructure-related tasks. One of the most prominent applications is the detection of vehicles, for which deep learning approaches are increasingly used. A major challenge in such approaches is the limited amount of data that arises, for example, when more specialized and rarer vehicles such as agricultural machinery or construction vehicles are to be detected. This lack of data contrasts with the enormous data hunger of deep learning methods in general and object recognition in particular. In this article, we address this issue in the context of the detection of road vehicles in aerial images. To overcome the lack of annotated data, we propose a generative approach that generates top-down images by overlaying artificial vehicles created from 2D CAD drawings on artificial or real backgrounds. Our experiments with a modified RetinaNet object detection network show that adding these images to small real-world datasets significantly improves detection performance. In cases of very limited or even no real-world images, we observe an improvement in average precision of up to 0.70 points. We address the remaining performance gap to real-world datasets by analyzing the effect of the image composition of background and objects and give insights into the importance of background.
arXiv comment14 pages, 13 figures, 4 tables
References in corpus (17)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- YOLOv4: Optimal Speed and Accuracy of Object Detection
- A Simple Framework for Contrastive Learning of Visual Representations
- mixup: Beyond Empirical Risk Minimization
- Improved Regularization of Convolutional Neural Networks with Cutout
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
- A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay
- CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
- MixMatch: A Holistic Approach to Semi-Supervised Learning
- Data Augmentation using Random Image Cropping and Patching for Deep CNNs
- A Simple Semi-Supervised Learning Framework for Object Detection
- Bag of Freebies for Training Object Detection Neural Networks
- Retina U-Net: Embarrassingly Simple Exploitation of Segmentation Supervision for Medical Object Detection
- Satellite Imagery Multiscale Rapid Detection with Windowed Networks
- Salience Biased Loss for Object Detection in Aerial Images
- RarePlanes: Synthetic Data Takes Flight