Motion Selective Prediction for Video Frame Synthesis
arXiv:1812.10157
Abstract
Existing conditional video prediction approaches train a network from large databases and generalize to previously unseen data. We take the opposite stance, and introduce a model that learns from the first frames of a given video and extends its content and motion, to, eg, double its length. To this end, we propose a dual network that can use in a flexible way both dynamic and static convolutional motion kernels, to predict future frames. The construct of our model gives us the the means to efficiently analyze its functioning and interpret its output. We demonstrate experimentally the robustness of our approach on challenging videos in-the-wild and show that it is competitive wrt related baselines.
References in corpus (9)
- Deep Image Prior
- Decomposing Motion and Content for Natural Video Sequence Prediction
- Stochastic Video Generation with a Learned Prior
- Unsupervised Learning for Physical Interaction through Video Prediction
- Unsupervised Learning of Disentangled Representations from Video
- Stochastic Adversarial Video Prediction
- Learning to Generate Long-term Future via Hierarchical Prediction
- Learning to Decompose and Disentangle Representations for Video Prediction
- Hierarchical Long-term Video Prediction without Supervision