ReHAR: Robust and Efficient Human Activity Recognition

Abstract

Designing a scheme that can achieve a good performance in predicting single person activities and group activities is a challenging task. In this paper, we propose a novel robust and efficient human activity recognition scheme called ReHAR, which can be used to handle single person activities and group activities prediction. First, we generate an optical flow image for each video frame. Then, both video frames and their corresponding optical flow images are fed into a Single Frame Representation Model to generate representations. Finally, an LSTM is used to pre- dict the final activities based on the generated representations. The whole model is trained end-to-end to allow meaningful representations to be generated for the final activity recognition. We evaluate ReHAR using two well-known datasets: the NCAA Basketball Dataset and the UCFSports Action Dataset. The experimental results show that the pro- posed ReHAR achieves a higher activity recognition accuracy with an order of magnitude shorter computation time compared to the state-of-the-art methods.

arXiv commentAccepted by WACV 2018

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Two-Stream Convolutional Networks for Action Recognition in Videos
• UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild
• FlowNet: Learning Optical Flow with Convolutional Networks
• Convolutional Two-Stream Network Fusion for Video Action Recognition
• Descriptor Matching with Convolutional Neural Networks: a Comparison to SIFT
• Learning to track for spatio-temporal action localization
• Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos
• FCN-rLSTM: Deep Spatio-Temporal Neural Networks for Vehicle Counting in City Cameras
• A Deep Architecture for Semantic Parsing