Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation
arXiv:1909.00589
Abstract
Deep learning-based semantic segmentation methods have an intrinsic limitation that training a model requires a large amount of data with pixel-level annotations. To address this challenging issue, many researchers give attention to unsupervised domain adaptation for semantic segmentation. Unsupervised domain adaptation seeks to adapt the model trained on the source domain to the target domain. In this paper, we introduce a self-ensembling technique, one of the successful methods for domain adaptation in classification. However, applying self-ensembling to semantic segmentation is very difficult because heavily-tuned manual data augmentation used in self-ensembling is not useful to reduce the large domain gap in the semantic segmentation. To overcome this limitation, we propose a novel framework consisting of two components, which are complementary to each other. First, we present a data augmentation method based on Generative Adversarial Networks (GANs), which is computationally efficient and effective to facilitate domain alignment. Given those augmented images, we apply self-ensembling to enhance the performance of the segmentation network on the target domain. The proposed method outperforms state-of-the-art semantic segmentation methods on unsupervised domain adaptation benchmarks.
arXiv commentAccepted to International Conference on Computer Vision (ICCV) 2019
References in corpus (12)
- Spectral Normalization for Generative Adversarial Networks
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
- Temporal Ensembling for Semi-Supervised Learning
- Toward Multimodal Image-to-Image Translation
- Learning to Discover Cross-Domain Relations with Generative Adversarial Networks
- FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation
- Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
- Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
- Domain Stylization: A Strong, Simple Baseline for Synthetic to Real Image Domain Adaptation
- Augmented Cyclic Adversarial Learning for Low Resource Domain Adaptation
- Pixel Level Data Augmentation for Semantic Image Segmentation using Generative Adversarial Networks