Is First Person Vision Challenging for Object Tracking?

Abstract

Understanding human-object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Visual tracking solutions available in the computer vision literature have significantly improved their performance in the last years for a large variety of target objects and tracking scenarios. However, despite a few previous attempts to exploit trackers in FPV applications, a methodical analysis of the performance of state-of-the-art trackers in this domain is still missing. In this paper, we fill the gap by presenting the first systematic study of object tracking in FPV. Our study extensively analyses the performance of recent visual trackers and baseline FPV trackers with respect to different aspects and considering a new performance measure. This is achieved through TREK-150, a novel benchmark dataset composed of 150 densely annotated video sequences. Our results show that object tracking in FPV is challenging, which suggests that more research efforts should be devoted to this problem so that tracking could benefit FPV tasks.

IEEE/CVF International Conference on Computer Vision (ICCV) 2021, Visual Object Tracking Challenge VOT2021 workshop. arXiv admin note: text overlap with arXiv:2011.12263

References in corpus (9)

• High-Speed Tracking with Kernelized Correlation Filters
• GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wild
• DCFNet: Discriminant Correlation Filters Network for Visual Tracking
• Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor
• Rolling-Unrolling LSTMs for Action Anticipation from First-Person Video
• Next-Active-Object prediction from Egocentric Videos
• Visual Tracking by means of Deep Reinforcement Learning and an Expert Demonstrator
• Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation
• An Exploration of Target-Conditioned Segmentation Methods for Visual Object Trackers