Text-to-Image-to-Text Translation using Cycle Consistent Adversarial Networks
arXiv:1808.04538
Abstract
Text-to-Image translation has been an active area of research in the recent past. The ability for a network to learn the meaning of a sentence and generate an accurate image that depicts the sentence shows ability of the model to think more like humans. Popular methods on text to image translation make use of Generative Adversarial Networks (GANs) to generate high quality images based on text input, but the generated images don't always reflect the meaning of the sentence given to the model as input. We address this issue by using a captioning network to caption on generated images and exploit the distance between ground truth captions and generated captions to improve the network further. We show extensive comparisons between our method and existing methods.
References in corpus (8)
- Conditional Generative Adversarial Nets
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
- Generative Adversarial Text to Image Synthesis
- Unsupervised Image-to-Image Translation Networks
- A Note on the Inception Score
- TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network
- Towards Diverse and Natural Image Descriptions via a Conditional GAN