Spatio-Temporal Dual Affine Differential Invariant for Skeleton-based Action Recognition
arXiv:2004.09802
Abstract
The dynamics of human skeletons have significant information for the task of action recognition. The similarity between trajectories of corresponding joints is an indicating feature of the same action, while this similarity may subject to some distortions that can be modeled as the combination of spatial and temporal affine transformations. In this work, we propose a novel feature called spatio-temporal dual affine differential invariant (STDADI). Furthermore, in order to improve the generalization ability of neural networks, a channel augmentation method is proposed. On the large scale action recognition dataset NTU-RGB+D, and its extended version NTU-RGB+D 120, it achieves remarkable improvements over previous state-of-the-art methods.
References in corpus (4)
- NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding
- Two-Stream 3D Convolutional Neural Network for Skeleton-Based Action Recognition
- Elastic Functional Coding of Riemannian Trajectories
- Skeleton based action recognition using translation-scale invariant image mapping and multi-scale deep cnn