Attend in groups: a weakly-supervised deep learning framework for learning from web data

Abstract

Large-scale datasets have driven the rapid development of deep neural networks for visual recognition. However, annotating a massive dataset is expensive and time-consuming. Web images and their labels are, in comparison, much easier to obtain, but direct training on such automatically harvested images can lead to unsatisfactory performance, because the noisy labels of Web images adversely affect the learned recognition models. To address this drawback we propose an end-to-end weakly-supervised deep learning framework which is robust to the label noise in Web images. The proposed framework relies on two unified strategies -- random grouping and attention -- to effectively reduce the negative impact of noisy web image annotations. Specifically, random grouping stacks multiple images into a single training instance and thus increases the labeling accuracy at the instance level. Attention, on the other hand, suppresses the noisy signals from both incorrectly labeled images and less discriminative image regions. By conducting intensive experiments on two challenging datasets, including a newly collected fine-grained dataset with Web images of different car models, the superior performance of the proposed methods over competitive baselines is clearly demonstrated.

References in corpus (13)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Hierarchical Question-Image Co-Attention for Visual Question Answering
• Theano: new features and speed improvements
• Fully Convolutional Networks for Semantic Segmentation
• Multiple Object Recognition with Visual Attention
• Training Deep Neural Networks on Noisy Labels with Bootstrapping
• Rich feature hierarchies for accurate object detection and semantic segmentation
• Training Convolutional Networks with Noisy Labels
• Noise Tolerance under Risk Minimization
• Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering
• Webly Supervised Learning of Convolutional Networks
• The Unreasonable Effectiveness of Noisy Data for Fine-Grained Recognition

Cited by in corpus (3)

• Decoupling "when to update" from "how to update"
• A Semi-Supervised Two-Stage Approach to Learning from Noisy Labels
• Image to Video Domain Adaptation Using Web Supervision