Unsupervised Meta-learning of Figure-Ground Segmentation via Imitating Visual Effects

Abstract

This paper presents a "learning to learn" approach to figure-ground image segmentation. By exploring webly-abundant images of specific visual effects, our method can effectively learn the visual-effect internal representations in an unsupervised manner and uses this knowledge to differentiate the figure from the ground in an image. Specifically, we formulate the meta-learning process as a compositional image editing task that learns to imitate a certain visual effect and derive the corresponding internal representation. Such a generative process can help instantiate the underlying figure-ground notion and enables the system to accomplish the intended image segmentation. Whereas existing generative methods are mostly tailored to image synthesis or style transfer, our approach offers a flexible learning mechanism to model a general concept of figure-ground segmentation from unorganized images that have no explicit pixel-level annotations. We validate our approach via extensive experiments on six datasets to demonstrate that the proposed model can be end-to-end trained without ground-truth pixel labeling yet outperforms the existing methods of unsupervised segmentation tasks.

References in corpus (7)

• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Improved Training of Wasserstein GANs
• Unsupervised Image-to-Image Translation Networks
• SalGAN: Visual Saliency Prediction with Generative Adversarial Networks
• DualGAN: Unsupervised Dual Learning for Image-to-Image Translation
• BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation