Multi-domain Collaborative Feature Representation for Robust Visual Object Tracking

Abstract

Jointly exploiting multiple different yet complementary domain information has been proven to be an effective way to perform robust object tracking. This paper focuses on effectively representing and utilizing complementary features from the frame domain and event domain for boosting object tracking performance in challenge scenarios. Specifically, we propose Common Features Extractor (CFE) to learn potential common representations from the RGB domain and event domain. For learning the unique features of the two domains, we utilize a Unique Extractor for Event (UEE) based on Spiking Neural Networks to extract edge cues in the event domain which may be missed in RGB in some challenging conditions, and a Unique Extractor for RGB (UER) based on Deep Convolutional Neural Networks to extract texture and semantic information in RGB domain. Extensive experiments on standard RGB benchmark and real event tracking dataset demonstrate the effectiveness of the proposed approach. We show our approach outperforms all compared state-of-the-art tracking algorithms and verify event-based data is a powerful cue for tracking in challenging scenes.

References in corpus (9)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• High-Speed Tracking with Kernelized Correlation Filters
• Deep Learning in Spiking Neural Networks
• SLAYER: Spike Layer Error Reassignment in Time
• Event-based Moving Object Detection and Tracking
• DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution with Large Factors
• A Two-Stage Attentive Network for Single Image Super-Resolution
• End-to-end Learning of Object Motion Estimation from Retinal Events for Event-based Object Tracking
• Asynchronous Tracking-by-Detection on Adaptive Time Surfaces for Event-based Object Tracking