TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
arXiv:1803.10794
Abstract
Despite the numerous developments in object tracking, further development of current tracking algorithms is limited by small and mostly saturated datasets. As a matter of fact, data-hungry trackers based on deep-learning currently rely on object detection datasets due to the scarcity of dedicated large-scale tracking datasets. In this work, we present TrackingNet, the first large-scale dataset and benchmark for object tracking in the wild. We provide more than 30K videos with more than 14 million dense bounding box annotations. Our dataset covers a wide selection of object classes in broad and diverse context. By releasing such a large-scale dataset, we expect deep trackers to further improve and generalize. In addition, we introduce a new benchmark composed of 500 novel videos, modeled with a distribution similar to our training dataset. By sequestering the annotation of the test set and providing an online evaluation server, we provide a fair benchmark for future development of object trackers. Deep trackers fine-tuned on a fraction of our dataset improve their performance by up to 1.6% on OTB100 and up to 1.7% on TrackingNet Test. We provide an extensive benchmark on TrackingNet by evaluating more than 20 trackers. Our results suggest that object tracking in the wild is far from being solved.
arXiv commentpreprint
References in corpus (5)
- Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
- MOT16: A Benchmark for Multi-Object Tracking
- MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
- A Novel Performance Evaluation Methodology for Single-Target Trackers
- Need for Speed: A Benchmark for Higher Frame Rate Object Tracking
Cited by in corpus (21)
- Fast Online Object Tracking and Segmentation: A Unifying Approach
- Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking
- Target Transformed Regression for Accurate Tracking
- Do Different Tracking Tasks Require Different Appearance Models?
- Unsupervised Deep Tracking
- Efficient Bird Eye View Proposals for 3D Siamese Tracking
- Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
- Benchmarking Deep Trackers on Aerial Videos
- An In-Depth Analysis of Visual Tracking with Siamese Neural Networks
- A Review of Visual Trackers and Analysis of its Application to Mobile Robot
- IoU Attack: Towards Temporally Coherent Black-Box Adversarial Attack for Visual Object Tracking
- Performance Evaluation Methodology for Long-Term Visual Object Tracking
- ROAM: Recurrently Optimizing Tracking Model
- Accurate Anchor Free Tracking
- Pyramid Correlation based Deep Hough Voting for Visual Object Tracking
- SiamRCR: Reciprocal Classification and Regression for Visual Object Tracking
- Learning Global Structure Consistency for Robust Object Tracking
- Multi-Drone based Single Object Tracking with Agent Sharing Network
- Efficient video annotation with visual interpolation and frame selection guidance
- Saliency-Associated Object Tracking
- SFTrack++: A Fast Learnable Spectral Segmentation Approach for Space-Time Consistent Tracking