High-Speed Tracking with Kernelized Correlation Filters
arXiv:1404.7584 · doi:10.1109/TPAMI.2014.2345390
Abstract
The core component of most modern trackers is a discriminative classifier, tasked with distinguishing between the target and the surrounding environment. To cope with natural image changes, this classifier is typically trained with translated and scaled sample patches. Such sets of samples are riddled with redundancies -- any overlapping pixels are constrained to be the same. Based on this simple observation, we propose an analytic model for datasets of thousands of translated patches. By showing that the resulting data matrix is circulant, we can diagonalize it with the Discrete Fourier Transform, reducing both storage and computation by several orders of magnitude. Interestingly, for linear regression our formulation is equivalent to a correlation filter, used by some of the fastest competitive trackers. For kernel regression, however, we derive a new Kernelized Correlation Filter (KCF), that unlike other kernel algorithms has the exact same complexity as its linear counterpart. Building on it, we also propose a fast multi-channel extension of linear correlation filters, via a linear kernel, which we call Dual Correlation Filter (DCF). Both KCF and DCF outperform top-ranking trackers such as Struck or TLD on a 50 videos benchmark, despite running at hundreds of frames-per-second, and being implemented in a few lines of code (Algorithm 1). To encourage further developments, our tracking framework was made open-source.
Cited by in corpus (29)
- Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
- Learning Spatially Regularized Correlation Filters for Visual Tracking
- Transferring Rich Feature Hierarchies for Robust Visual Tracking
- Robust Visual Tracking Revisited: From Correlation Filter to Template Matching
- Understanding and Diagnosing Visual Tracking Systems
- BIT: Biologically Inspired Tracker
- Target-Aware Deep Tracking
- Automatic individual pig detection and tracking in surveillance videos
- Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking
- Prediction-Tracking-Segmentation
- Visualizing the Invisible: Occluded Vehicle Segmentation and Recovery
- Performance Evaluation Methodology for Long-Term Visual Object Tracking
- Real-Time Visual Tracking: Promoting the Robustness of Correlation Filter Learning
- Synthetic Defocus and Look-Ahead Autofocus for Casual Videography
- Responsive Action-based Video Synthesis
- MAVBench: Micro Aerial Vehicle Benchmarking
- Semi-supervised Breast Lesion Detection in Ultrasound Video Based on Temporal Coherence
- The Role of Compute in Autonomous Aerial Vehicles
- Learning Rotation Adaptive Correlation Filters in Robust Visual Object Tracking
- Adaptive Feature Representation for Visual Tracking
- Faster Spatially Regularized Correlation Filters for Visual Tracking
- End-to-end feature fusion siamese network for adaptive visual tracking
- Patch-based adaptive weighting with segmentation and scale (PAWSS) for visual tracking
- Dense Semantic Correspondence where Every Pixel is a Classifier
- Structured Group Local Sparse Tracker
- Self-Selective Correlation Ship Tracking Method for Smart Ocean System
- Real-time tracker with fast recovery from target loss
- Drone Shadow Tracking
- A Strong Feature Representation for Siamese Network Tracker