A Hybrid Data Association Framework for Robust Online Multi-Object Tracking

Abstract

Global optimization algorithms have shown impressive performance in data-association based multi-object tracking, but handling online data remains a difficult hurdle to overcome. In this paper, we present a hybrid data association framework with a min-cost multi-commodity network flow for robust online multi-object tracking. We build local target-specific models interleaved with global optimization of the optimal data association over multiple video frames. More specifically, in the min-cost multi-commodity network flow, the target-specific similarities are online learned to enforce the local consistency for reducing the complexity of the global data association. Meanwhile, the global data association taking multiple video frames into account alleviates irrecoverable errors caused by the local data association between adjacent frames. To ensure the efficiency of online tracking, we give an efficient near-optimal solution to the proposed min-cost multi-commodity flow problem, and provide the empirical proof of its sub-optimality. The comprehensive experiments on real data demonstrate the superior tracking performance of our approach in various challenging situations.

References in corpus (2)

• Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation
• Temporal Dynamic Appearance Modeling for Online Multi-Person Tracking

Cited by in corpus (6)

• Deep Learning in Video Multi-Object Tracking: A Survey
• MOANA: An Online Learned Adaptive Appearance Model for Robust Multiple Object Tracking in 3D
• Spatio-Temporal Point Process for Multiple Object Tracking
• Machine Learning Methods for Data Association in Multi-Object Tracking
• Adaptive Affinity for Associations in Multi-Target Multi-Camera Tracking
• Multi-Object Tracking with Deep Learning Ensemble for Unmanned Aerial System Applications