Large-Scale Attribute-Object Compositions
arXiv:2105.11373
Abstract
We study the problem of learning how to predict attribute-object compositions from images, and its generalization to unseen compositions missing from the training data. To the best of our knowledge, this is a first large-scale study of this problem, involving hundreds of thousands of compositions. We train our framework with images from Instagram using hashtags as noisy weak supervision. We make careful design choices for data collection and modeling, in order to handle noisy annotations and unseen compositions. Finally, extensive evaluations show that learning to compose classifiers outperforms late fusion of individual attribute and object predictions, especially in the case of unseen attribute-object pairs.
References in corpus (10)
- Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
- SGDR: Stochastic Gradient Descent with Warm Restarts
- Revisiting Unreasonable Effectiveness of Data in Deep Learning Era
- Visual Translation Embedding Network for Visual Relation Detection
- Pedestrian Attribute Recognition: A Survey
- Recovering the Missing Link: Predicting Class-Attribute Associations for Unsupervised Zero-Shot Learning
- Walk and Learn: Facial Attribute Representation Learning from Egocentric Video and Contextual Data
- End-to-End Localization and Ranking for Relative Attributes
- Hard Mixtures of Experts for Large Scale Weakly Supervised Vision
- Learning to Infer Unseen Single-/Multi-Attribute-Object Compositions with Graph Networks