Slot Contrastive Networks: A Contrastive Approach for Representing Objects
arXiv:2007.09294
Abstract
Unsupervised extraction of objects from low-level visual data is an important goal for further progress in machine learning. Existing approaches for representing objects without labels use structured generative models with static images. These methods focus a large amount of their capacity on reconstructing unimportant background pixels, missing low contrast or small objects. Conversely, we present a new method that avoids losses in pixel space and over-reliance on the limited signal a static image provides. Our approach takes advantage of objects' motion by learning a discriminative, time-contrastive loss in the space of slot representations, attempting to force each slot to not only capture entities that move, but capture distinct objects from the other slots. Moreover, we introduce a new quantitative evaluation metric to measure how "diverse" a set of slot vectors are, and use it to evaluate our model on 20 Atari games.
Presented at ICML 2020 Workshop: Object-Oriented Learning (OOL): Perception, Representation, and Reasoning
References in corpus (14)
- A Simple Framework for Contrastive Learning of Visual Representations
- Momentum Contrast for Unsupervised Visual Representation Learning
- Data-Efficient Image Recognition with Contrastive Predictive Coding
- Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations
- Interaction Networks for Learning about Objects, Relations and Physics
- Learning to Simulate Complex Physics with Graph Networks
- Multi-Object Representation Learning with Iterative Variational Inference
- MONet: Unsupervised Scene Decomposition and Representation
- Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and their Interactions
- Unsupervised Learning of Object Landmarks through Conditional Image Generation
- Sequential Attend, Infer, Repeat: Generative Modelling of Moving Objects
- SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
- Contrastive Learning of Structured World Models
- Structured Object-Aware Physics Prediction for Video Modeling and Planning