MOANA: An Online Learned Adaptive Appearance Model for Robust Multiple Object Tracking in 3D
arXiv:1901.02626 · doi:10.1109/ACCESS.2019.2903121
Abstract
Multiple object tracking has been a challenging field, mainly due to noisy detection sets and identity switch caused by occlusion and similar appearance among nearby targets. Previous works rely on appearance models built on individual or several selected frames for the comparison of features, but they cannot encode long-term appearance changes caused by pose, viewing angle and lighting conditions. In this work, we propose an adaptive model that learns online a relatively long-term appearance change of each target. The proposed model is compatible with any feature of fixed dimension or their combination, whose learning rates are dynamically controlled by adaptive update and spatial weighting schemes. To handle occlusion and nearby objects sharing similar appearance, we also design cross-matching and re-identification schemes based on the application of the proposed adaptive appearance models. Additionally, the 3D geometry information is effectively incorporated in our formulation for data association. The proposed method outperforms all the state-of-the-art on the MOTChallenge 3D benchmark and achieves real-time computation with only a standard desktop CPU. It has also shown superior performance over the state-of-the-art on the 2D benchmark of MOTChallenge.
Accepted to be published at IEEE Access (Special Section: AI-Driven Big Data Processing: Theory, Methodology, and Applications)
References in corpus (6)
- MOT16: A Benchmark for Multi-Object Tracking
- MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
- Deep Continuous Conditional Random Fields with Asymmetric Inter-object Constraints for Online Multi-object Tracking
- Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation
- A Multi-cut Formulation for Joint Segmentation and Tracking of Multiple Objects
- A Hybrid Data Association Framework for Robust Online Multi-Object Tracking
Cited by in corpus (11)
- RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization
- Multi-Target Multi-Camera Tracking of Vehicles using Metadata-Aided Re-ID and Trajectory-Based Camera Link Model
- Traffic-Aware Multi-Camera Tracking of Vehicles Based on ReID and Camera Link Model
- CityFlow-NL: Tracking and Retrieval of Vehicles at City Scale by Natural Language Descriptions
- CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification
- PIC-Net: Point Cloud and Image Collaboration Network for Large-Scale Place Recognition
- Multi-level Traffic-Responsive Tilt Camera Surveillance through Predictive Correlated Online Learning
- Using Panoramic Videos for Multi-person Localization and Tracking in a 3D Panoramic Coordinate
- The 6th AI City Challenge
- Video Surveillance for Road Traffic Monitoring
- RODNet: Radar Object Detection Using Cross-Modal Supervision