Improving Object Detection with Selective Self-supervised Self-training

Abstract

We study how to leverage Web images to augment human-curated object detection datasets. Our approach is two-pronged. On the one hand, we retrieve Web images by image-to-image search, which incurs less domain shift from the curated data than other search methods. The Web images are diverse, supplying a wide variety of object poses, appearances, their interactions with the context, etc. On the other hand, we propose a novel learning method motivated by two parallel lines of work that explore unlabeled data for image classification: self-training and self-supervised learning. They fail to improve object detectors in their vanilla forms due to the domain gap between the Web images and curated datasets. To tackle this challenge, we propose a selective net to rectify the supervision signals in Web images. It not only identifies positive bounding boxes but also creates a safe zone for mining hard negative boxes. We report state-of-the-art results on detecting backpacks and chairs from everyday scenes, along with other challenging object classes.

Accepted to ECCV 2020

References in corpus (14)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• A Simple Framework for Contrastive Learning of Visual Representations
• R-FCN: Object Detection via Region-based Fully Convolutional Networks
• Unsupervised Data Augmentation for Consistency Training
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Temporal Ensembling for Semi-Supervised Learning
• Momentum Contrast for Unsupervised Visual Representation Learning
• Semi-Supervised Learning with Ladder Networks
• Learning with Pseudo-Ensembles
• Billion-scale semi-supervised learning for image classification
• Self-training with Noisy Student improves ImageNet classification
• Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination
• Improving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effect
• Weakly- and Semi-Supervised Object Detection with Expectation-Maximization Algorithm