Image2GIF: Generating Cinemagraphs using Recurrent Deep Q-Networks
arXiv:1801.09042
Abstract
Given a still photograph, one can imagine how dynamic objects might move against a static background. This idea has been actualized in the form of cinemagraphs, where the motion of particular objects within a still image is repeated, giving the viewer a sense of animation. In this paper, we learn computational models that can generate cinemagraph sequences automatically given a single image. To generate cinemagraphs, we explore combining generative models with a recurrent neural network and deep Q-networks to enhance the power of sequence generation. To enable and evaluate these models we make use of two datasets, one synthetically generated and the other containing real video generated cinemagraphs. Both qualitative and quantitative evaluations demonstrate the effectiveness of our models on the synthetic and real datasets.
WACV2018
References in corpus (12)
- Adam: A Method for Stochastic Optimization
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
- Progressive Growing of GANs for Improved Quality, Stability, and Variation
- DRAW: A Recurrent Neural Network For Image Generation
- Generating Videos with Scene Dynamics
- BEGAN: Boundary Equilibrium Generative Adversarial Networks
- Deep multi-scale video prediction beyond mean square error
- Video (language) modeling: a baseline for generative models of natural videos
- Unsupervised Learning for Physical Interaction through Video Prediction
- Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks
- Video Pixel Networks