Good Features to Correlate for Visual Tracking
arXiv:1704.06326 · doi:10.1109/TIP.2018.2806280
Abstract
During the recent years, correlation filters have shown dominant and spectacular results for visual object tracking. The types of the features that are employed in these family of trackers significantly affect the performance of visual tracking. The ultimate goal is to utilize robust features invariant to any kind of appearance change of the object, while predicting the object location as properly as in the case of no appearance change. As the deep learning based methods have emerged, the study of learning features for specific tasks has accelerated. For instance, discriminative visual tracking methods based on deep architectures have been studied with promising performance. Nevertheless, correlation filter based (CFB) trackers confine themselves to use the pre-trained networks which are trained for object classification problem. To this end, in this manuscript the problem of learning deep fully convolutional features for the CFB visual tracking is formulated. In order to learn the proposed model, a novel and efficient backpropagation algorithm is presented based on the loss function of the network. The proposed learning framework enables the network model to be flexible for a custom design. Moreover, it alleviates the dependency on the network trained for classification. Extensive performance analysis shows the efficacy of the proposed custom design in the CFB tracking framework. By fine-tuning the convolutional parts of a state-of-the-art network and integrating this model to a CFB tracker, which is the top performing one of VOT2016, 18% increase is achieved in terms of expected average overlap, and tracking failures are decreased by 25%, while maintaining the superiority over the state-of-the-art methods in OTB-2013 and OTB-2015 tracking datasets.
Accepted version of IEEE Transactions on Image Processing
References in corpus (7)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- High-Speed Tracking with Kernelized Correlation Filters
- Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
- Learning Spatially Regularized Correlation Filters for Visual Tracking
- Modeling and Propagating CNNs in a Tree Structure for Visual Tracking
- DCFNet: Discriminant Correlation Filters Network for Visual Tracking
- Correlation Filters with Limited Boundaries
Cited by in corpus (27)
- Deep Learning for Visual Tracking: A Comprehensive Survey
- Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Tracking
- Deeper and Wider Siamese Networks for Real-Time Visual Tracking
- Siamese Attentional Keypoint Network for High Performance Visual Tracking
- Real-Time Correlation Tracking via Joint Model Compression and Transfer
- Learning to Update for Object Tracking with Recurrent Meta-learner
- Siamese Cascaded Region Proposal Networks for Real-Time Visual Tracking
- High Performance Visual Tracking with Circular and Structural Operators
- TRAT: Tracking by Attention Using Spatio-Temporal Features
- Joint Group Feature Selection and Discriminative Filter Learning for Robust Visual Object Tracking
- Multi-hierarchical Independent Correlation Filters for Visual Tracking
- Benchmarking Deep Trackers on Aerial Videos
- An In-Depth Analysis of Visual Tracking with Siamese Neural Networks
- A Review of Visual Trackers and Analysis of its Application to Mobile Robot
- AFAT: Adaptive Failure-Aware Tracker for Robust Visual Object Tracking
- Learning Spatial-Aware Regressions for Visual Tracking
- Learning Feature Embeddings for Discriminant Model based Tracking
- Anomaly Detection in Residential Video Surveillance on Edge Devices in IoT Framework
- DSNet: Deep and Shallow Feature Learning for Efficient Visual Tracking
- Fast Kernelized Correlation Filters without Boundary Effect
- Unified Graph based Multi-Cue Feature Fusion for Robust Visual Tracking
- Real Time Visual Tracking using Spatial-Aware Temporal Aggregation Network
- Model-free Tracking with Deep Appearance and Motion Features Integration
- MobiFace: A Novel Dataset for Mobile Face Tracking in the Wild
- ROI Pooled Correlation Filters for Visual Tracking
- A Strong Feature Representation for Siamese Network Tracker
- Efficient Multi-level Correlating for Visual Tracking