Weakly Supervised Instance Segmentation by Deep Community Learning

Abstract

We present a weakly supervised instance segmentation algorithm based on deep community learning with multiple tasks. This task is formulated as a combination of weakly supervised object detection and semantic segmentation, where individual objects of the same class are identified and segmented separately. We address this problem by designing a unified deep neural network architecture, which has a positive feedback loop of object detection with bounding box regression, instance mask generation, instance segmentation, and feature extraction. Each component of the network makes active interactions with others to improve accuracy, and the end-to-end trainability of our model makes our results more robust and reproducible. The proposed algorithm achieves state-of-the-art performance in the weakly supervised setting without any additional training such as Fast R-CNN and Mask R-CNN on the standard benchmark dataset. The implementation of our algorithm is available on the project webpage: https://cv.snu.ac.kr/research/WSIS_CL.

arXiv commentWACV 2021

References in corpus (15)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Rethinking Atrous Convolution for Semantic Image Segmentation
• YOLOv3: An Incremental Improvement
• Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
• Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• Recurrent Models of Visual Attention
• Joint Learning of Saliency Detection and Weakly Supervised Semantic Segmentation
• Weakly Supervised Learning of Instance Segmentation with Inter-pixel Relations
• Weakly Supervised Instance Segmentation using Class Peak Response
• Weakly-Supervised Semantic Segmentation by Iteratively Mining Common Object Features
• Multiple Instance Detection Network with Online Instance Classifier Refinement
• Object Counting and Instance Segmentation with Image-level Supervision
• Label-PEnet: Sequential Label Propagation and Enhancement Networks for Weakly Supervised Instance Segmentation