Exploit the Connectivity: Multi-Object Tracking with TrackletNet

Abstract

Multi-object tracking (MOT) is an important and practical task related to both surveillance systems and moving camera applications, such as autonomous driving and robotic vision. However, due to unreliable detection, occlusion and fast camera motion, tracked targets can be easily lost, which makes MOT very challenging. Most recent works treat tracking as a re-identification (Re-ID) task, but how to combine appearance and temporal features is still not well addressed. In this paper, we propose an innovative and effective tracking method called TrackletNet Tracker (TNT) that combines temporal and appearance information together as a unified framework. First, we define a graph model which treats each tracklet as a vertex. The tracklets are generated by appearance similarity with CNN features and intersection-over-union (IOU) with epipolar constraints to compensate camera movement between adjacent frames. Then, for every pair of two tracklets, the similarity is measured by our designed multi-scale TrackletNet. Afterwards, the tracklets are clustered into groups which represent individual object IDs. Our proposed TNT has the ability to handle most of the challenges in MOT, and achieve promising results on MOT16 and MOT17 benchmark datasets compared with other state-of-the-art methods.

References in corpus (9)

• MOT16: A Benchmark for Multi-Object Tracking
• T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos
• Simple Online and Realtime Tracking with a Deep Association Metric
• A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objects
• Multi-Target, Multi-Camera Tracking by Hierarchical Clustering: Recent Progress on DukeMTMC Project
• Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies
• Trajectory Factory: Tracklet Cleaving and Re-connection by Deep Siamese Bi-GRU for Multiple Object Tracking
• Fusion of Head and Full-Body Detectors for Multi-Object Tracking
• Online Multi-Object Tracking with Historical Appearance Matching and Scene Adaptive Detection Filtering

Cited by in corpus (3)

• RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization
• Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model
• State-aware Re-identification Feature for Multi-target Multi-camera Tracking