Beyond Correlation Filters: Learning Continuous Convolution Operators for Visual Tracking
arXiv:1608.03773 · doi:10.1007/978-3-319-46454-1_29
Abstract
Discriminative Correlation Filters (DCF) have demonstrated excellent performance for visual object tracking. The key to their success is the ability to efficiently exploit available negative data by including all shifted versions of a training sample. However, the underlying DCF formulation is restricted to single-resolution feature maps, significantly limiting its potential. In this paper, we go beyond the conventional DCF framework and introduce a novel formulation for training continuous convolution filters. We employ an implicit interpolation model to pose the learning problem in the continuous spatial domain. Our proposed formulation enables efficient integration of multi-resolution deep feature maps, leading to superior results on three object tracking benchmarks: OTB-2015 (+5.1% in mean OP), Temple-Color (+4.6% in mean OP), and VOT2015 (20% relative reduction in failure rate). Additionally, our approach is capable of sub-pixel localization, crucial for the task of accurate feature point tracking. We also demonstrate the effectiveness of our learning formulation in extensive feature point tracking experiments. Code and supplementary material are available at http://www.cvl.isy.liu.se/research/objrec/visualtracking/conttrack/index.html.
Accepted at ECCV 2016
References in corpus (4)
Cited by in corpus (161)
- GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
- Deep Learning for Visual Tracking: A Comprehensive Survey
- Discriminative Correlation Filter with Channel and Spatial Reliability
- Context-aware Deep Feature Compression for High-speed Visual Tracking
- RGBT Tracking via Multi-Adapter Network with Hierarchical Divergence Loss
- Dense Feature Aggregation and Pruning for RGBT Tracking
- Sim4CV: A Photo-Realistic Simulator for Computer Vision Applications
- A Review of Tracking, Prediction and Decision Making Methods for Autonomous Driving
- Good Features to Correlate for Visual Tracking
- Distilled Siamese Networks for Visual Tracking
- SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks
- A Comprehensive Performance Evaluation of Deformable Face Tracking "In-the-Wild"
- Deeper and Wider Siamese Networks for Real-Time Visual Tracking
- Siamese Attentional Keypoint Network for High Performance Visual Tracking
- Learning Reinforced Attentional Representation for End-to-End Visual Tracking
- Correlation Filters for Unmanned Aerial Vehicle-Based Aerial Tracking: A Review and Experimental Evaluation
- 3D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloud
- Distractor-aware Siamese Networks for Visual Object Tracking
- TrTr: Visual Tracking with Transformer
- Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
- Hypernetwork functional image representation
- Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things
- State-aware Anti-drift Robust Correlation Tracking
- Real-Time Correlation Tracking via Joint Model Compression and Transfer
- Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Tracking
- Adaptive Siamese Tracking with a Compact Latent Network
- SiamVGG: Visual Tracking using Deeper Siamese Networks
- GradNet: Gradient-Guided Network for Visual Object Tracking
- TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wild
- Siamese Infrared and Visible Light Fusion Network for RGB-T Tracking
- SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Tracking
- Learning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking
- Parallel Tracking and Verifying
- Deformable Object Tracking with Gated Fusion
- Target Transformed Regression for Accurate Tracking
- Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking
- Target-Aware Deep Tracking
- Unsupervised Deep Tracking
- TRAT: Tracking by Attention Using Spatio-Temporal Features
- An Accelerated Correlation Filter Tracker
- High Performance Visual Tracking with Circular and Structural Operators
- Deformable Siamese Attention Networks for Visual Object Tracking
- Joint Group Feature Selection and Discriminative Filter Learning for Robust Visual Object Tracking
- Siamese Box Adaptive Network for Visual Tracking
- SPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking
- Robust Visual Tracking using Multi-Frame Multi-Feature Joint Modeling
- Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark
- Benchmarking Deep Trackers on Aerial Videos
- Integration of the 3D Environment for UAV Onboard Visual Object Tracking
- LaSOT: A High-quality Large-scale Single Object Tracking Benchmark
- Tracking-by-Trackers with a Distilled and Reinforced Model
- AutoTrack: Towards High-Performance Visual Tracking for UAV with Automatic Spatio-Temporal Regularization
- Detection and Tracking Meet Drones Challenge
- BoLTVOS: Box-Level Tracking for Video Object Segmentation
- Remove Cosine Window from Correlation Filter-based Visual Trackers: When and How
- Learning the Model Update for Siamese Trackers
- Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking
- HiFT: Hierarchical Feature Transformer for Aerial Tracking
- Siamese Keypoint Prediction Network for Visual Object Tracking
- Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking
- Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
- Prediction-Tracking-Segmentation
- Deep Convolutional Correlation Iterative Particle Filter for Visual Tracking
- SiamMan: Siamese Motion-aware Network for Visual Tracking
- Measuring the Accuracy of Object Detectors and Trackers
- A Review of Visual Trackers and Analysis of its Application to Mobile Robot
- MAVOT: Memory-Augmented Video Object Tracking
- Subpixel-Precise Tracking of Rigid Objects in Real-time
- SiamCorners: Siamese Corner Networks for Visual Tracking
- Unsupervised Deep Representation Learning for Real-Time Tracking
- AFAT: Adaptive Failure-Aware Tracker for Robust Visual Object Tracking
- Coarse-to-Fine Object Tracking Using Deep Features and Correlation Filters
- FANet: Quality-Aware Feature Aggregation Network for Robust RGB-T Tracking
- TCDCaps: Visual Tracking via Cascaded Dense Capsules
- Improving Model Drift for Robust Object Tracking
- Learning Feature Embeddings for Discriminant Model based Tracking
- Large Margin Structured Convolution Operator for Thermal Infrared Object Tracking
- Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
- CyLKs: Unsupervised Cycle Lucas-Kanade Network for Landmark Tracking
- Part-based Tracking by Sampling
- Unsupervised Lightweight Single Object Tracking with UHP-SOT++
- Real-Time Object Tracking via Meta-Learning: Efficient Model Adaptation and One-Shot Channel Pruning
- Proposal, Tracking and Segmentation (PTS): A Cascaded Network for Video Object Segmentation
- Towards Robust Visual Tracking for Unmanned Aerial Vehicle with Tri-Attentional Correlation Filters
- DR^2Track: Towards Real-Time Visual Tracking for UAV via Distractor Repressed Dynamic Regression
- Training-Set Distillation for Real-Time UAV Object Tracking
- COMET: Context-Aware IoU-Guided Network for Small Object Tracking
- SiamEvent: Event-based Object Tracking via Edge-aware Similarity Learning with Siamese Networks
- Human Following for Wheeled Robot with Monocular Pan-tilt Camera
- Joint Representation and Truncated Inference Learning for Correlation Filter based Tracking
- Efficient Adversarial Attacks for Visual Object Tracking
- Robust Visual Object Tracking with Two-Stream Residual Convolutional Networks
- Augmented Memory for Correlation Filters in Real-Time UAV Tracking
- Mutation Sensitive Correlation Filter for Real-Time UAV Tracking with Adaptive Hybrid Label
- F-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking
- DAWN: Dual Augmented Memory Network for Unsupervised Video Object Tracking
- Online Multi-Object Tracking with Dual Matching Attention Networks
- ROAM: Recurrently Optimizing Tracking Model
- Visual Tracking via Dynamic Memory Networks
- Real-time Visual Object Tracking with Natural Language Description
- Towards a Better Match in Siamese Network Based Visual Object Tracker
- Robust Instance Tracking via Uncertainty Flow
- Graph Attention Tracking
- Object Tracking Using Spatio-Temporal Future Prediction
- DSNet: Deep and Shallow Feature Learning for Efficient Visual Tracking
- AViTMP: A Tracking-Specific Transformer for Single-Branch Visual Tracking
- Learning Global Structure Consistency for Robust Object Tracking
- An Exploration of Target-Conditioned Segmentation Methods for Visual Object Trackers
- Learning Spatio-Appearance Memory Network for High-Performance Visual Tracking
- Beyond Background-Aware Correlation Filters: Adaptive Context Modeling by Hand-Crafted and Deep RGB Features for Visual Tracking
- Hallucinated Adversarial Learning for Robust Visual Tracking
- Hard Negative Samples Emphasis Tracker without Anchors
- High Performance Visual Object Tracking with Unified Convolutional Networks
- Robust Tracking against Adversarial Attacks
- Fast Kernelized Correlation Filters without Boundary Effect
- DCCO: Towards Deformable Continuous Convolution Operators
- Transparent Object Tracking Benchmark
- SPSTracker: Sub-Peak Suppression of Response Map for Robust Object Tracking
- A single target tracking algorithm based on Generative Adversarial Networks
- Rethinking Convolutional Features in Correlation Filter Based Tracking
- Real Time Visual Tracking using Spatial-Aware Temporal Aggregation Network
- Automatic Failure Recovery and Re-Initialization for Online UAV Tracking with Joint Scale and Aspect Ratio Optimization
- Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking
- High Speed Tracking With A Fourier Domain Kernelized Correlation Filter
- TSDM: Tracking by SiamRPN++ with a Depth-refiner and a Mask-generator
- Learning Rotation Adaptive Correlation Filters in Robust Visual Object Tracking
- FPAN: Fine-grained and Progressive Attention Localization Network for Data Retrieval
- Progressive Multi-Stage Learning for Discriminative Tracking
- Keyfilter-Aware Real-Time UAV Object Tracking
- Saliency-Associated Object Tracking
- Hierarchical Feature-Aware Tracking
- Generic Multiview Visual Tracking
- Material Based Object Tracking in Hyperspectral Videos: Benchmark and Algorithms
- Handcrafted and Deep Trackers: Recent Visual Object Tracking Approaches and Trends
- Region-filtering Correlation Tracking
- End-to-end feature fusion siamese network for adaptive visual tracking
- RSINet: Rotation-Scale Invariant Network for Online Visual Tracking
- 3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds
- "Who is Driving around Me?" Unique Vehicle Instance Classification using Deep Neural Features
- Efficient Multi-level Correlating for Visual Tracking
- Relation3DMOT: Exploiting Deep Affinity for 3D Multi-Object Tracking from View Aggregation
- Class agnostic moving target detection by color and location prediction of moving area
- Leveraging Tacit Information Embedded in CNN Layers for Visual Tracking
- Phase Space Reconstruction Network for Lane Intrusion Action Recognition
- DMV: Visual Object Tracking via Part-level Dense Memory and Voting-based Retrieval
- Cascaded Regression Tracking: Towards Online Hard Distractor Discrimination
- Robust Visual Tracking via Implicit Low-Rank Constraints and Structural Color Histograms
- ROI Pooled Correlation Filters for Visual Tracking
- Motion Prediction in Visual Object Tracking
- Saliency based Semi-supervised Learning for Orbiting Satellite Tracking
- Tracking the Untrackable
- Learning Consistency Pursued Correlation Filters for Real-Time UAV Tracking
- Multi-Modal Fusion for End-to-End RGB-T Tracking
- Equivalence of Correlation Filter and Convolution Filter in Visual Tracking
- Multi-Adapter RGBT Tracking
- A Strong Feature Representation for Siamese Network Tracker
- Tracking system of Mine Patrol Robot for Low Illumination Environment
- Learning Dynamic Compact Memory Embedding for Deformable Visual Object Tracking
- Real-time tracker with fast recovery from target loss
- Tracking by Joint Local and Global Search: A Target-aware Attention based Approach
- Box-Aware Feature Enhancement for Single Object Tracking on Point Clouds