Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification
arXiv:1809.04427 · doi:10.1109/ICME.2018.8486597
Abstract
Online multi-object tracking is a fundamental problem in time-critical video analysis applications. A major challenge in the popular tracking-by-detection framework is how to associate unreliable detection results with existing tracks. In this paper, we propose to handle unreliable detection by collecting candidates from outputs of both detection and tracking. The intuition behind generating redundant candidates is that detection and tracks can complement each other in different scenarios. Detection results of high confidence prevent tracking drifts in the long term, and predictions of tracks can handle noisy detection caused by occlusion. In order to apply optimal selection from a considerable amount of candidates in real-time, we present a novel scoring function based on a fully convolutional neural network, that shares most computations on the entire image. Moreover, we adopt a deeply learned appearance representation, which is trained on large-scale person re-identification datasets, to improve the identification ability of our tracker. Extensive experiments show that our tracker achieves real-time and state-of-the-art performance on a widely used people tracking benchmark.
ICME 2018
Cited by in corpus (16)
- FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
- HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking
- Tracking without bells and whistles
- Deep Learning in Video Multi-Object Tracking: A Survey
- Advances and Applications of Computer Vision Techniques in Vehicle Trajectory Generation and Surrogate Traffic Safety Indicators
- Spatio-Temporal Point Process for Multiple Object Tracking
- Human in Events: A Large-Scale Benchmark for Human-centric Video Analysis in Complex Events
- Online Multi-Object Tracking Framework with the GMPHD Filter and Occlusion Group Management
- Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors
- An Overview of Multi-Object Estimation via Labeled Random Finite Set
- A CRF-based Framework for Tracklet Inactivation in Online Multi-Object Tracking
- Joint Detection and Tracking in Videos with Identification Features
- A Cost-Effective Person-Following System for Assistive Unmanned Vehicles with Deep Learning at the Edge
- Monocular Per-Object Distance Estimation with Masked Object Modeling
- SPAMming Labels: Efficient Annotations for the Trackers of Tomorrow
- A Novel Carrier Waveform Inter-Displacement Modulation Method in Underwater Communication Channel