GANILLA: Generative Adversarial Networks for Image to Illustration Translation

Abstract

In this paper, we explore illustrations in children's books as a new domain in unpaired image-to-image translation. We show that although the current state-of-the-art image-to-image translation models successfully transfer either the style or the content, they fail to transfer both at the same time. We propose a new generator network to address this issue and show that the resulting network strikes a better balance between style and content. There are no well-defined or agreed-upon evaluation metrics for unpaired image-to-image translation. So far, the success of image translation models has been based on subjective, qualitative visual comparison on a limited number of images. To address this problem, we propose a new framework for the quantitative evaluation of image-to-illustration models, where both content and style are taken into account using separate classifiers. In this new evaluation framework, our proposed model performs better than the current state-of-the-art models on the illustrations dataset. Our code and pretrained models can be found at https://github.com/giddyyupp/ganilla.

arXiv commentto be published in Image and Vision Computing

References in corpus (11)

• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Instance Normalization: The Missing Ingredient for Fast Stylization
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Energy-based Generative Adversarial Network
• Unsupervised Cross-Domain Image Generation
• DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
• Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses
• An Introduction to Image Synthesis with Generative Adversarial Nets
• Learning to Generate Images of Outdoor Scenes from Attributes and Semantic Layouts
• Neural Style Transfer: A Review
• Incorporating long-range consistency in CNN-based texture generation

Cited by in corpus (1)

• Generative Adversarial Networks for photo to Hayao Miyazaki style cartoons