247 citations · 907 across the 14 of their papers we have counts for
6 papers · 1 filter
Neural Multisensory Scene Inference
Jae Hyun Lim, Pedro O. Pinheiro, Negar Rostamzadeh +2
For embodied agents to infer representations of the underlying 3D physical world they inhabit, they should efficiently combine multisensory cues from numerous trials, e.g., by look…
Generative Hierarchical Models for Parts, Objects, and Scenes
Fei Deng, Zhuo Zhi, Sungjin Ahn
Compositional structures between parts and objects are inherent in natural scenes. Modeling such compositional hierarchies via unsupervised learning can bring various benefits such…
Variational Temporal Abstraction
Taesup Kim, Sungjin Ahn, Yoshua Bengio
We introduce a variational approach to learning and inference of temporally hierarchical structure and representation for sequential data. We propose the Variational Temporal Abstr…
SCALOR: Generative World Models with Scalable Object Representations
Jindong Jiang, Sepehr Janghorbani, Gerard de Melo +1
Scalability in terms of object density in a scene is a primary challenge in unsupervised sequential object-oriented representation learning. Most of the previous models have been s…
Sequential Neural Processes
Gautam Singh, Jaesik Yoon, Youngsung Son +1
Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large cla…
Reinforced Imitation in Heterogeneous Action Space
Konrad Zolna, Negar Rostamzadeh, Yoshua Bengio +2
Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an…