Tracking without bells and whistles
arXiv:1903.05625 · doi:10.1109/ICCV.2019.00103
Abstract
The problem of tracking multiple objects in a video sequence poses several challenging tasks. For tracking-by-detection, these include object re-identification, motion prediction and dealing with occlusions. We present a tracker (without bells and whistles) that accomplishes tracking without specifically targeting any of these tasks, in particular, we perform no training or optimization on tracking data. To this end, we exploit the bounding box regression of an object detector to predict the position of an object in the next frame, thereby converting a detector into a Tracktor. We demonstrate the potential of Tracktor and provide a new state-of-the-art on three multi-object tracking benchmarks by extending it with a straightforward re-identification and camera motion compensation. We then perform an analysis on the performance and failure cases of several state-of-the-art tracking methods in comparison to our Tracktor. Surprisingly, none of the dedicated tracking methods are considerably better in dealing with complex tracking scenarios, namely, small and occluded objects or missing detections. However, our approach tackles most of the easy tracking scenarios. Therefore, we motivate our approach as a new tracking paradigm and point out promising future research directions. Overall, Tracktor yields superior tracking performance than any current tracking method and our analysis exposes remaining and unsolved tracking challenges to inspire future research directions.
References in corpus (4)
- MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking
- Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification
- Object Detection in Videos with Tubelet Proposal Networks
- Tracking the Trackers: An Analysis of the State of the Art in Multiple Object Tracking
Cited by in corpus (39)
- FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking
- HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking
- Deep Learning for UAV-based Object Detection and Tracking: A Survey
- RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization
- A Review of Tracking, Prediction and Decision Making Methods for Autonomous Driving
- SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videos
- JRDB: A Dataset and Benchmark of Egocentric Robot Visual Perception of Humans in Built Environments
- DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association
- Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets
- Continuous Human Action Recognition for Human-Machine Interaction: A Review
- Spatio-Temporal Point Process for Multiple Object Tracking
- Self-Supervised Small Soccer Player Detection and Tracking
- Machine Learning Methods for Data Association in Multi-Object Tracking
- TDIOT: Target-driven Inference for Deep Video Object Tracking
- Keypoint Promptable Re-Identification
- PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search
- Lost and Found: Overcoming Detector Failures in Online Multi-Object Tracking
- Learning Data Association for Multi-Object Tracking using Only Coordinates
- A CRF-based Framework for Tracklet Inactivation in Online Multi-Object Tracking
- Transformers for Multi-Object Tracking on Point Clouds
- HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images
- SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos
- Statistical Hypothesis Testing Based on Machine Learning: Large Deviations Analysis
- Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction
- SDOF-Tracker: Fast and Accurate Multiple Human Tracking by Skipped-Detection and Optical-Flow
- Tracking Passengers and Baggage Items using Multiple Overhead Cameras at Security Checkpoints
- Tracking Passengers and Baggage Items Using Multiple Overhead Cameras at Security Checkpoints
- Video-based Sequential Bayesian Homography Estimation for Soccer Field Registration
- Efficient Vision-based Vehicle Speed Estimation
- Learnable Graph Matching: A Practical Paradigm for Data Association
- Spatial-Temporal Deep Embedding for Vehicle Trajectory Reconstruction from High-Angle Video
- SpikeMOT: Event-based Multi-Object Tracking with Sparse Motion Features
- Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark
- CAMOT: Camera Angle-aware Multi-Object Tracking
- Synthesizing Trajectory Queries from Examples
- SPAMming Labels: Efficient Annotations for the Trackers of Tomorrow
- Cell Tracking according to Biological Needs -- Strong Mitosis-aware Multi-Hypothesis Tracker with Aleatoric Uncertainty
- Accurate Tracking of Arabidopsis Root Cortex Cell Nuclei in 3D Time-Lapse Microscopy Images Based on Genetic Algorithm
- FasterVideo: Efficient Online Joint Object Detection And Tracking