Similarity R-C3D for Few-shot Temporal Activity Detection
arXiv:1812.10000
Abstract
Many activities of interest are rare events, with only a few labeled examples available. Therefore models for temporal activity detection which are able to learn from a few examples are desirable. In this paper, we present a conceptually simple and general yet novel framework for few-shot temporal activity detection which detects the start and end time of the few-shot input activities in an untrimmed video. Our model is end-to-end trainable and can benefit from more few-shot examples. At test time, each proposal is assigned the label of the few-shot activity class corresponding to the maximum similarity score. Our Similarity R-C3D method outperforms previous work on three large-scale benchmarks for temporal activity detection (THUMOS14, ActivityNet1.2, and ActivityNet1.3 datasets) in the few-shot setting. Our code will be made available.
References in corpus (8)
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Prototypical Networks for Few-shot Learning
- UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild
- A Simple Neural Attentive Meta-Learner
- One-shot Learning with Memory-Augmented Neural Networks
- Temporal Activity Detection in Untrimmed Videos with Recurrent Neural Networks
- Attentive Recurrent Comparators
- AutoLoc: Weakly-supervised Temporal Action Localization