GANtruth - an unpaired image-to-image translation method for driving scenarios
arXiv:1812.01710
Abstract
Synthetic image translation has significant potentials in autonomous transportation systems. That is due to the expense of data collection and annotation as well as the unmanageable diversity of real-words situations. The main issue with unpaired image-to-image translation is the ill-posed nature of the problem. In this work, we propose a novel method for constraining the output space of unpaired image-to-image translation. We make the assumption that the environment of the source domain is known (e.g. synthetically generated), and we propose to explicitly enforce preservation of the ground-truth labels on the translated images. We experiment on preserving ground-truth information such as semantic segmentation, disparity, and instance segmentation. We show significant evidence that our method achieves improved performance over the state-of-the-art model of UNIT for translating images from SYNTHIA to Cityscapes. The generated images are perceived as more realistic in human surveys and outperforms UNIT when used in a domain adaptation scenario for semantic segmentation.
arXiv comment32nd Conference on Neural Information Processing Systems (NeurIPS), Machine Learning for Intelligent Transportation Systems Workshop, Montréal, Canada. 2018
References in corpus (6)
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
- The Cityscapes Dataset for Semantic Urban Scene Understanding
- Unsupervised Image-to-Image Translation Networks
- DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
- ICNet for Real-Time Semantic Segmentation on High-Resolution Images
- Generative Visual Manipulation on the Natural Image Manifold