Semi-Recurrent CNN-based VAE-GAN for Sequential Data Generation
arXiv:1806.00509
Abstract
A semi-recurrent hybrid VAE-GAN model for generating sequential data is introduced. In order to consider the spatial correlation of the data in each frame of the generated sequence, CNNs are utilized in the encoder, generator, and discriminator. The subsequent frames are sampled from the latent distributions obtained by encoding the previous frames. As a result, the dependencies between the frames are maintained. Two testing frameworks for synthesizing a sequence with any number of frames are also proposed. The promising experimental results on piano music generation indicates the potential of the proposed framework in modeling other sequential data such as video.
arXiv comment5 pages, 6 figures, ICASSP 2018
References in corpus (10)
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- WaveNet: A Generative Model for Raw Audio
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- Autoencoding beyond pixels using a learned similarity metric
- Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models
- C-RNN-GAN: Continuous recurrent neural networks with adversarial training
- MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generation
- Variational Recurrent Auto-Encoders
- DeepBach: a Steerable Model for Bach Chorales Generation
- Imposing higher-level Structure in Polyphonic Music Generation using Convolutional Restricted Boltzmann Machines and Constraints