CIAN: Cross-Image Affinity Net for Weakly Supervised Semantic Segmentation

Abstract

Weakly supervised semantic segmentation with only image-level labels saves large human effort to annotate pixel-level labels. Cutting-edge approaches rely on various innovative constraints and heuristic rules to generate the masks for every single image. Although great progress has been achieved by these methods, they treat each image independently and do not take account of the relationships across different images. In this paper, however, we argue that the cross-image relationship is vital for weakly supervised segmentation. Because it connects related regions across images, where supplementary representations can be propagated to obtain more consistent and integral regions. To leverage this information, we propose an end-to-end cross-image affinity module, which exploits pixel-level cross-image relationships with only image-level labels. By means of this, our approach achieves 64.3% and 65.3% mIoU on Pascal VOC 2012 validation and test set respectively, which is a new state-of-the-art result by only using image-level labels for weakly supervised semantic segmentation, demonstrating the superiority of our approach.

arXiv comment9 pages, 4 figures, AAAI 2020

References in corpus (7)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
• STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation
• Non-local Neural Networks
• BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation
• Weakly Supervised Semantic Segmentation Based on Web Image Co-segmentation
• Convolutional Simplex Projection Network (CSPN) for Weakly Supervised Semantic Segmentation