From the 1 of 5 linked papers with an AI index.
4 papers · 1 filter
Gen4U: Unifying Video Generation and Understanding via Diffusion
Michael King, Aravindh Mahendran, Matthew Koichi Grimes +5
Prior work suggests that diffusion representations capture low-level geometry but struggle with high-level semantics. We demonstrate that state-of-the-art video diffusion models ov…
Frozen Forecasting: A Unified Evaluation
Jacob C Walker, Pedro Vélez, Luisa Polania Cabrera +7
Forecasting future events is a fundamental capability for general-purpose systems that plan or act across different levels of abstraction. Yet, evaluating whether a forecast is "co…
Scaling 4D Representations
João Carreira, Dilara Gokay, Michael King +32
Scaling has not yet been convincingly demonstrated for pure self-supervised learning from video. However, prior work has focused evaluations on semantic-related tasks $\unicode{x20…
From Image to Video: An Empirical Study of Diffusion Representations
Pedro Vélez, Luisa F. PolanÃa, Yi Yang +4
Diffusion models have revolutionized generative modeling, enabling unprecedented realism in image and video synthesis. This success has sparked interest in leveraging their represe…