Benchmarking Deep Trackers on Aerial Videos
arXiv:2103.12924 · doi:10.3390/s20020547
Abstract
In recent years, deep learning-based visual object trackers have achieved state-of-the-art performance on several visual object tracking benchmarks. However, most tracking benchmarks are focused on ground level videos, whereas aerial tracking presents a new set of challenges. In this paper, we compare ten trackers based on deep learning techniques on four aerial datasets. We choose top performing trackers utilizing different approaches, specifically tracking by detection, discriminative correlation filters, Siamese networks and reinforcement learning. In our experiments, we use a subset of OTB2015 dataset with aerial style videos; the UAV123 dataset without synthetic sequences; the UAV20L dataset, which contains 20 long sequences; and DTB70 dataset as our benchmark datasets. We compare the advantages and disadvantages of different trackers in different tracking situations encountered in aerial data. Our findings indicate that the trackers perform significantly worse in aerial datasets compared to standard ground level videos. We attribute this effect to smaller target size, camera motion, significant camera rotation with respect to the target, out of view movement, and clutter in the form of occlusions or similar looking distractors near tracked object.
arXiv comment25 pages, 10 figures, 7 tables
References in corpus (22)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- High-Speed Tracking with Kernelized Correlation Filters
- Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
- Learning Spatially Regularized Correlation Filters for Visual Tracking
- Modeling and Propagating CNNs in a Tree Structure for Visual Tracking
- Good Features to Correlate for Visual Tracking
- SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks
- Deeper and Wider Siamese Networks for Real-Time Visual Tracking
- Distractor-aware Siamese Networks for Visual Object Tracking
- Multi-Class Multi-Object Tracking using Changing Point Detection
- Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking
- A Twofold Siamese Network for Real-Time Object Tracking
- TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
- Learning Policies for Adaptive Tracking with Deep Feature Cascades
- YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video
- Need for Speed: A Benchmark for Higher Frame Rate Object Tracking
- Target-Aware Deep Tracking
- Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
- LaSOT: A High-quality Benchmark for Large-scale Single Object Tracking
- Long-term Tracking in the Wild: A Benchmark
- Multi-hierarchical Independent Correlation Filters for Visual Tracking
- SPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking