The Evolution of First Person Vision Methods: A Survey
arXiv:1409.1484 · doi:10.1109/TCSVT.2015.2409731
Abstract
The emergence of new wearable technologies such as action cameras and smart-glasses has increased the interest of computer vision scientists in the First Person perspective. Nowadays, this field is attracting attention and investments of companies aiming to develop commercial devices with First Person Vision recording capabilities. Due to this interest, an increasing demand of methods to process these videos, possibly in real-time, is expected. Current approaches present a particular combinations of different image features and quantitative methods to accomplish specific objectives like object detection, activity recognition, user machine interaction and so on. This paper summarizes the evolution of the state of the art in First Person Vision video analysis between 1997 and 2014, highlighting, among others, most commonly used features, methods, challenges and opportunities within the field.
arXiv commentFirst Person Vision, Egocentric Vision, Wearable Devices, Smart Glasses, Computer Vision, Video Analytics, Human-machine Interaction
References in corpus (5)
- Predicting Important Objects for Egocentric Video Summarization
- 3D Hand Pose Detection in Egocentric RGB-D Images
- Egocentric Field-of-View Localization Using First-Person Point-of-View Devices
- Human Daily Activities Indexing in Videos from Wearable Cameras for Monitoring of Patients with Dementia Diseases
- Egocentric Pose Recognition in Four Lines of Code
Cited by in corpus (16)
- Analysis of the hands in egocentric vision: A survey
- Mutual Context Network for Jointly Estimating Egocentric Gaze and Actions
- Towards Storytelling from Visual Lifelogging: An Overview
- Forecasting User Attention During Everyday Mobile Interactions Using Device-Integrated and Wearable Sensors
- Left/Right Hand Segmentation in Egocentric Videos
- Digging Deeper into Egocentric Gaze Prediction
- Multi-modal Egocentric Activity Recognition using Audio-Visual Features
- From Face Recognition to Models of Identity: A Bayesian Approach to Learning about Unknown Identities from Unsupervised Data
- Sensor-Augmented Egocentric-Video Captioning with Dynamic Modal Attention
- A Correlation Based Feature Representation for First-Person Activity Recognition
- In the Eye of the Beholder: Gaze and Actions in First Person Video
- Enhanced Self-Perception in Mixed Reality: Egocentric Arm Segmentation and Database with Automatic Labelling
- Unsupervised Understanding of Location and Illumination Changes in Egocentric Videos
- Hier-EgoPack: Hierarchical Egocentric Video Understanding with Diverse Task Perspectives
- Measuring hand use in the home after cervical spinal cord injury using egocentric video
- You-Do, I-Learn: Unsupervised Multi-User egocentric Approach Towards Video-Based Guidance