7 papers
AdaJEPA: An Adaptive Latent World Model
Ying Wang, Oumayma Bounou, Yann LeCun +1
Latent world models enable planning from high-dimensional observations by predicting future states in a compact latent space. However, these models are typically kept frozen at tes…
Temporal Straightening for Latent Planning
Ying Wang, Oumayma Bounou, Gaoyue Zhou +4
Learning good representations is essential for latent planning with world models. While pretrained visual encoders produce strong semantic visual features, they are not tailored to…
Continual Visual and Verbal Learning Through a Child's Egocentric Input
Xiaoyang Jiang, Yanlai Yang, Kenneth A. Norman +2
Children learn the meanings of words from a continuous, temporally structured stream of egocentric experience. Recent work shows that neural networks can also learn word-referent m…
Generative Recursive Reasoning
Junyeob Baek, Mingyu Jo, Minsu Kim +3
How should future neural reasoning systems implement extended computation? Recursive Reasoning Models (RRMs) offer a promising alternative to autoregressive sequence extension by p…
Seeking the Unfamiliar but Memorable: Conceptual Creativity as Meta-Learning
Mengye Ren
What does it mean to create a new concept, rather than retrieve a familiar one? Repeatedly sampling a generative model at the same prompt produces variations with similar styles an…
Midway Network: Learning Representations for Recognition and Motion from Latent Dynamics
Christopher Hoang, Mengye Ren
Object recognition and motion understanding are key components of perception that complement each other. While self-supervised learning methods have shown promise in their ability…