PTB-TIR: A Thermal Infrared Pedestrian Tracking Benchmark

Abstract

Thermal infrared (TIR) pedestrian tracking is one of the important components among numerous applications of computer vision, which has a major advantage: it can track pedestrians in total darkness. The ability to evaluate the TIR pedestrian tracker fairly, on a benchmark dataset, is significant for the development of this field. However, there is not a benchmark dataset. In this paper, we develop a TIR pedestrian tracking dataset for the TIR pedestrian tracker evaluation. The dataset includes 60 thermal sequences with manual annotations. Each sequence has nine attribute labels for the attribute based evaluation. In addition to the dataset, we carry out the large-scale evaluation experiments on our benchmark dataset using nine publicly available trackers. The experimental results help us understand the strengths and weaknesses of these trackers.In addition, in order to gain more insight into the TIR pedestrian tracker, we divide its functions into three components: feature extractor, motion model, and observation model. Then, we conduct three comparison experiments on our benchmark dataset to validate how each component affects the tracker's performance. The findings of these experiments provide some guidelines for future research. The dataset and evaluation toolkit can be downloaded at {https://github.com/QiaoLiuHit/PTB-TIR_Evaluation_toolkit}.

arXiv comment10 pages,IEEE Transactions on Multimedia (2019)

References in corpus (3)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• High-Speed Tracking with Kernelized Correlation Filters
• Learning Spatially Regularized Correlation Filters for Visual Tracking

Cited by in corpus (15)

• GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
• LSOTB-TIR:A Large-Scale High-Diversity Thermal Infrared Object Tracking Benchmark
• Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
• Unsupervised Cross-Modal Distillation for Thermal Infrared Tracking
• Evaluation of Thermal Imaging on Embedded GPU Platforms for Application in Vehicular Assistance Systems
• Towards Accurate Pixel-wise Object Tracking by Attention Retrieval
• In Defense and Revival of Bayesian Filtering for Thermal Infrared Object Tracking
• Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation
• Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video Dataset
• Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark
• Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey
• SOTVerse: A User-defined Task Space of Single Object Tracking
• Multi-Task Driven Feature Models for Thermal Infrared Tracking
• Predictive Visual Tracking: A New Benchmark and Baseline Approach
• Deep Learning-based Human Detection for UAVs with Optical and Infrared Cameras: System and Experiments