Learning to score the figure skating sports videos
arXiv:1802.02774
Abstract
This paper targets at learning to score the figure skating sports videos. To address this task, we propose a deep architecture that includes two complementary components, i.e., Self-Attentive LSTM and Multi-scale Convolutional Skip LSTM. These two components can efficiently learn the local and global sequential information in each video. Furthermore, we present a large-scale figure skating sports video dataset -- FisV dataset. This dataset includes 500 figure skating videos with the average length of 2 minutes and 50 seconds. Each video is annotated by two scores of nine different referees, i.e., Total Element Score(TES) and Total Program Component Score (PCS). Our proposed model is validated on FisV and MIT-skate datasets. The experimental results show the effectiveness of our models in learning to score the figure skating videos.
References in corpus (11)
- Two-Stream Convolutional Networks for Action Recognition in Videos
- UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild
- A Structured Self-attentive Sentence Embedding
- Exploiting Feature and Class Relationships in Video Categorization with Regularized Deep Neural Networks
- Convolutional Two-Stream Network Fusion for Video Action Recognition
- Beyond Short Snippets: Deep Networks for Video Classification
- Evaluating Two-Stream CNN for Video Classification
- Human Action Recognition using Factorized Spatio-Temporal Convolutional Networks
- Video Summarization with Long Short-term Memory
- VideoLSTM Convolves, Attends and Flows for Action Recognition
- Real-time Action Recognition with Enhanced Motion Vector CNNs