Delving into Robust Object Detection from Unmanned Aerial Vehicles: A Deep Nuisance Disentanglement Approach

Abstract

Object detection from images captured by Unmanned Aerial Vehicles (UAVs) is becoming increasingly useful. Despite the great success of the generic object detection methods trained on ground-to-ground images, a huge performance drop is observed when they are directly applied to images captured by UAVs. The unsatisfactory performance is owing to many UAV-specific nuisances, such as varying flying altitudes, adverse weather conditions, dynamically changing viewing angles, etc. Those nuisances constitute a large number of fine-grained domains, across which the detection model has to stay robust. Fortunately, UAVs will record meta-data that depict those varying attributes, which are either freely available along with the UAV images, or can be easily obtained. We propose to utilize those free meta-data in conjunction with associated UAV images to learn domain-robust features via an adversarial training framework dubbed Nuisance Disentangled Feature Transform (NDFT), for the specific challenging problem of object detection in UAV images, achieving a substantial gain in robustness to those nuisances. We demonstrate the effectiveness of our proposed algorithm, by showing state-of-the-art performance (single model) on two existing UAV-based object detection benchmarks. The code is available at https://github.com/TAMU-VITA/UAV-NDFT.

Accepted by International Conference on Computer Vision (ICCV) 2019

References in corpus (16)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Simple Online and Realtime Tracking
• R-FCN: Object Detection via Region-based Fully Convolutional Networks
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
• Unsupervised Domain Adaptation by Backpropagation
• CyCADA: Cycle-Consistent Adversarial Domain Adaptation
• Perceptual Generative Adversarial Networks for Small Object Detection
• ME R-CNN: Multi-Expert R-CNN for Object Detection
• Disentangling Factors of Variation via Generative Entangling
• Bridging the Gap Between Computational Photography and Visual Recognition
• SNIPER: Efficient Multi-Scale Training
• Studying Very Low Resolution Recognition Using Deep Networks
• Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study
• DADA: Deep Adversarial Data Augmentation for Extremely Low Data Regime Classification
• Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection
• Linear Disentangled Representation Learning for Facial Actions