Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model
arXiv:2008.09785 · doi:10.1145/3394171.3413863
Abstract
Multi-target multi-camera tracking (MTMCT), i.e., tracking multiple targets across multiple cameras, is a crucial technique for smart city applications. In this paper, we propose an effective and reliable MTMCT framework for vehicles, which consists of a traffic-aware single camera tracking (TSCT) algorithm, a trajectory-based camera link model (CLM) for vehicle re-identification (ReID), and a hierarchical clustering algorithm to obtain the cross camera vehicle trajectories. First, the TSCT, which jointly considers vehicle appearance, geometric features, and some common traffic scenarios, is proposed to track the vehicles in each camera separately. Second, the trajectory-based CLM is adopted to facilitate the relationship between each pair of adjacently connected cameras and add spatio-temporal constraints for the subsequent vehicle ReID with temporal attention. Third, the hierarchical clustering algorithm is used to merge the vehicle trajectories among all the cameras to obtain the final MTMCT results. Our proposed MTMCT is evaluated on the CityFlow dataset and achieves a new state-of-the-art performance with IDF1 of 74.93%.
arXiv commentAccepted by ACM International Conference on Multimedia 2020
References in corpus (11)
- SSD: Single Shot MultiBox Detector
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- YOLOv3: An Incremental Improvement
- In Defense of the Triplet Loss for Person Re-Identification
- Revisiting Temporal Modeling for Video-based Person ReID
- Multi-Target, Multi-Camera Tracking by Hierarchical Clustering: Recent Progress on DukeMTMC Project
- MOANA: An Online Learned Adaptive Appearance Model for Robust Multiple Object Tracking in 3D
- Exploit the Connectivity: Multi-Object Tracking with TrackletNet
- Vehicle Re-Identification: an Efficient Baseline Using Triplet Embedding
- Locality Aware Appearance Metric for Multi-Target Multi-Camera Tracking
- IA-MOT: Instance-Aware Multi-Object Tracking with Motion Consistency
Cited by in corpus (6)
- RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization
- Multi-Target Multi-Camera Tracking of Vehicles using Metadata-Aided Re-ID and Trajectory-Based Camera Link Model
- MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmark
- City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones
- Rethinking of Radar's Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment
- RODNet: Radar Object Detection Using Cross-Modal Supervision