5 papers
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
Minh-Quan Le, Armand Comas, Alexandros Lattas +7
Human cognition does not separate understanding and generation. A teacher at a whiteboard speaks and draws , each modality reshapes the other. In this paper, we…
Gen4U: Unifying Video Generation and Understanding via Diffusion
Michael King, Aravindh Mahendran, Matthew Koichi Grimes +5
Prior work suggests that diffusion representations capture low-level geometry but struggle with high-level semantics. We demonstrate that state-of-the-art video diffusion models ov…
Frozen Forecasting: A Unified Evaluation
Jacob C Walker, Pedro Vélez, Luisa Polania Cabrera +7
Forecasting future events is a fundamental capability for general-purpose systems that plan or act across different levels of abstraction. Yet, evaluating whether a forecast is "co…
From Image to Video: An Empirical Study of Diffusion Representations
Pedro Vélez, Luisa F. Polanía, Yi Yang +4
Diffusion models have revolutionized generative modeling, enabling unprecedented realism in image and video synthesis. This success has sparked interest in leveraging their represe…
Scaling 4D Representations
João Carreira, Dilara Gokay, Michael King +32
Scaling has not yet been convincingly demonstrated for pure self-supervised learning from video. However, prior work has focused evaluations on semantic-related tasks $\unicode{x20…