Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset

Abstract

YouTube-8M is the largest video dataset for multi-label video classification. In order to tackle the multi-label classification on this challenging dataset, it is necessary to solve several issues such as temporal modeling of videos, label imbalances, and correlations between labels. We develop a deep neural network model, which consists of four components: the frame encoder, the classification layer, the label processing layer, and the loss function. We introduce our newly proposed methods and discusses how existing models operate in the YouTube-8M Classification Task, what insights they have, and why they succeed (or fail) to achieve good performance. Most of the models we proposed are very high compared to the baseline models, and the ensemble of the models we used is 8th in the Kaggle Competition.

accepted at Youtube-8M CVPR'17 Workshop as Oral Presentation. Kaggle 8th model

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild
• YouTube-8M: A Large-Scale Video Classification Benchmark
• Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
• Uncovering Temporal Context for Video Question and Answering
• End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering