Human Action Performance using Deep Neuro-Fuzzy Recurrent Attention Model

Abstract

A great number of computer vision publications have focused on distinguishing between human action recognition and classification rather than the intensity of actions performed. Indexing the intensity which determines the performance of human actions is a challenging task due to the uncertainty and information deficiency that exists in the video inputs. To remedy this uncertainty, in this paper we coupled fuzzy logic rules with the neural-based action recognition model to rate the intensity of a human action as intense or mild. In our approach, we used a Spatio-Temporal LSTM to generate the weights of the fuzzy-logic model, and then demonstrate through experiments that indexing of the action intensity is possible. We analyzed the integrated model by applying it to videos of human actions with different action intensities and were able to achieve an accuracy of 89.16% on our intensity indexing generated dataset. The integrated model demonstrates the ability of a neuro-fuzzy inference module to effectively estimate the intensity index of human actions.

1 pages, 6 figures, 2 algorithms. Published at IEEE Access

References in corpus (12)

• Two-Stream Convolutional Networks for Action Recognition in Videos
• UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild
• The Kinetics Human Action Video Dataset
• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• A New Representation of Skeleton Sequences for 3D Action Recognition
• Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
• An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data
• Co-occurrence Feature Learning for Skeleton based Action Recognition using Regularized Deep LSTM Networks
• Human Action Recognition and Prediction: A Survey
• Action-Attending Graphic Neural Network
• Aggressive actions and anger detection from multiple modalities using Kinect
• A Multi-Layer K-means Approach for Multi-Sensor Data Pattern Recognition in Multi-Target Localization

Cited by in corpus (5)

• Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey
• AI-Augmented Behavior Analysis for Children with Developmental Disabilities: Building Towards Precision Treatment
• Learning from Few Samples: A Survey
• Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey
• A Self-supervised Approach for Semantic Indexing in the Context of COVID-19 Pandemic