Deep Learning for UAV-based Object Detection and Tracking: A Survey

Abstract

Owing to effective and flexible data acquisition, unmanned aerial vehicle (UAV) has recently become a hotspot across the fields of computer vision (CV) and remote sensing (RS). Inspired by recent success of deep learning (DL), many advanced object detection and tracking approaches have been widely applied to various UAV-related tasks, such as environmental monitoring, precision agriculture, traffic management. This paper provides a comprehensive survey on the research progress and prospects of DL-based UAV object detection and tracking methods. More specifically, we first outline the challenges, statistics of existing methods, and provide solutions from the perspectives of DL-based models in three research topics: object detection from the image, object detection from the video, and object tracking from the video. Open datasets related to UAV-dominated object detection and tracking are exhausted, and four benchmark datasets are employed for performance evaluation using some state-of-the-art methods. Finally, prospects and considerations for the future work are discussed and summarized. It is expected that this survey can facilitate those researchers who come from remote sensing field with an overview of DL-based UAV object detection and tracking methods, along with some thoughts on their further developments.

References in corpus (20)

• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Light-Head R-CNN: In Defense of Two-Stage Object Detector
• Simple Online and Realtime Tracking with a Deep Association Metric
• Multi-Object Tracking with Multiple Cues and Switcher-Aware Classification
• Perceptual Generative Adversarial Networks for Small Object Detection
• Efficient ConvNet-based Object Detection for Unmanned Aerial Vehicles by Selective Tile Processing
• Eye in the Sky: Drone-Based Object Tracking and 3D Localization
• RON: Reverse Connection with Objectness Prior Networks for Object Detection
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking
• Equivariant Transformer Networks
• Looking Fast and Slow: Memory-Guided Mobile Video Object Detection
• Impression Network for Video Object Detection
• Multi-Object Tracking with Siamese Track-RCNN
• HRDNet: High-resolution Detection Network for Small Objects
• PENet: Object Detection using Points Estimation in Aerial Images
• Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detection
• Guided Attention Network for Object Detection and Counting on Drones
• COMET: Context-Aware IoU-Guided Network for Small Object Tracking
• SCNN: A General Distribution based Statistical Convolutional Neural Network with Application to Video Object Detection