Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach

Abstract

We investigate a principle way to progressively mine discriminative object regions using classification networks to address the weakly-supervised semantic segmentation problems. Classification networks are only responsive to small and sparse discriminative regions from the object of interest, which deviates from the requirement of the segmentation task that needs to localize dense, interior and integral regions for pixel-wise inference. To mitigate this gap, we propose a new adversarial erasing approach for localizing and expanding object regions progressively. Starting with a single small object region, our proposed approach drives the classification network to sequentially discover new and complement object regions by erasing the current mined regions in an adversarial manner. These localized regions eventually constitute a dense and complete object region for learning semantic segmentation. To further enhance the quality of the discovered regions by adversarial erasing, an online prohibitive segmentation learning approach is developed to collaborate with adversarial erasing by providing auxiliary segmentation supervision modulated by the more reliable classification scores. Despite its apparent simplicity, the proposed approach achieves 55.0% and 55.7% mean Intersection-over-Union (mIoU) scores on PASCAL VOC 2012 val and test sets, which are the new state-of-the-arts.

arXiv commentAccepted to appear in CVPR 2017 (oral)

References in corpus (9)

• Caffe: Convolutional Architecture for Fast Feature Embedding
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• Conditional Random Fields as Recurrent Neural Networks
• CNN: Single-label to Multi-label
• STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation
• Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation
• Fully Convolutional Multi-Class Multiple Instance Learning
• Built-in Foreground/Background Prior for Weakly-Supervised Semantic Segmentation
• Constrained Convolutional Neural Networks for Weakly Supervised Segmentation

Cited by in corpus (8)

• Improving Referring Expression Grounding with Cross-modal Attention-guided Erasing
• Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation
• LID 2020: The Learning from Imperfect Data Challenge Results
• Adversarial Seeded Sequence Growing for Weakly-Supervised Temporal Action Localization
• What Synthesis is Missing: Depth Adaptation Integrated with Weak Supervision for Indoor Scene Parsing
• Dense Regression Activation Maps For Lesion Segmentation in CT scans of COVID-19 patients
• Learning to segment with image-level supervision
• Closed-Loop Adaptation for Weakly-Supervised Semantic Segmentation