FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
arXiv:2004.01888 · doi:10.1007/s11263-021-01513-4
Abstract
Multi-object tracking (MOT) is an important problem in computer vision which has a wide range of applications. Formulating MOT as multi-task learning of object detection and re-ID in a single network is appealing since it allows joint optimization of the two tasks and enjoys high computation efficiency. However, we find that the two tasks tend to compete with each other which need to be carefully addressed. In particular, previous works usually treat re-ID as a secondary task whose accuracy is heavily affected by the primary detection task. As a result, the network is biased to the primary detection task which is not fair to the re-ID task. To solve the problem, we present a simple yet effective approach termed as FairMOT based on the anchor-free object detection architecture CenterNet. Note that it is not a naive combination of CenterNet and re-ID. Instead, we present a bunch of detailed designs which are critical to achieve good tracking results by thorough empirical studies. The resulting approach achieves high accuracy for both detection and tracking. The approach outperforms the state-of-the-art methods by a large margin on several public datasets. The source code and pre-trained models are released at https://github.com/ifzhang/FairMOT.
IJCV 2021
References in corpus (3)
Cited by in corpus (45)
- A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions
- SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos
- DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association
- Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaboration
- Continuous Human Action Recognition for Human-Machine Interaction: A Review
- An Object SLAM Framework for Association, Mapping, and High-Level Tasks
- Visual Multi-Object Tracking with Re-Identification and Occlusion Handling using Labeled Random Finite Sets
- Advanced computer vision for extracting georeferenced vehicle trajectories from drone imagery
- An Overview of Multi-Object Estimation via Labeled Random Finite Set
- Keypoint Promptable Re-Identification
- Contrastive Learning for Multi-Object Tracking with Transformers
- Lost and Found: Overcoming Detector Failures in Online Multi-Object Tracking
- Multi-task Learning for Joint Re-identification, Team Affiliation, and Role Classification for Sports Visual Tracking
- SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos
- Deep Efficient Continuous Manifold Learning for Time Series Modeling
- Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory
- SDOF-Tracker: Fast and Accurate Multiple Human Tracking by Skipped-Detection and Optical-Flow
- Towards Frame Rate Agnostic Multi-Object Tracking
- ThreshNet: An Efficient DenseNet Using Threshold Mechanism to Reduce Connections
- Towards pedestrian head tracking: A benchmark dataset and a multi-source data fusion network
- MOT-DETR: 3D Single Shot Detection and Tracking with Transformers to build 3D representations for Agro-Food Robots
- Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Tracking
- Learnable Graph Matching: A Practical Paradigm for Data Association
- Multiple Object Tracking in Video SAR: A Benchmark and Tracking Baseline
- SIRA: Scalable Inter-frame Relation and Association for Radar Perception
- Generalized Semantic Contrastive Learning via Embedding Side Information for Few-Shot Object Detection
- Introduction of a tree-based technique for efficient and real-time label retrieval in the object tracking system
- SpikeMOT: Event-based Multi-Object Tracking with Sparse Motion Features
- YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID
- CAMOT: Camera Angle-aware Multi-Object Tracking
- Tracking by Detection and Query: An Efficient End-to-End Framework for Multi-Object Tracking
- SPAMming Labels: Efficient Annotations for the Trackers of Tomorrow
- FeatureSORT: Essential Features for Effective Tracking
- HIPer: A Human-Inspired Scene Perception Model for Multifunctional Mobile Robots
- Enhancing In-vehicle Multiple Object Tracking Systems with Embeddable Ising Machines
- Physical ID-Transfer Attacks against Multi-Object Tracking via Adversarial Trajectory
- A comparison between single-stage and two-stage 3D tracking algorithms for greenhouse robotics
- One Homography is All You Need: IMM-based Joint Homography and Multiple Object State Estimation
- Self-Supervised Real-Time Tracking of Military Vehicles in Low-FPS UAV Footage
- DMSORT: An efficient parallel maritime multi-object tracking architecture for unmanned vessel platforms
- Engineering an Efficient Object Tracker for Non-Linear Motion
- Online 3D Multi-Camera Perception through Robust 2D Tracking and Depth-based Late Aggregation
- The Mean of Multi-Object Trajectories
- Tiny Neural Networks for Multi-Object Tracking in a Modular Kalman Framework
- Accurate Tracking of Arabidopsis Root Cortex Cell Nuclei in 3D Time-Lapse Microscopy Images Based on Genetic Algorithm