8 citations · 13 across the 12 of their papers we have counts for
8 papers · 1 filter
UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation
Youssef Mansour, Enis Simsar, Fadime Sener +4
Distilling bidirectional multi-step video diffusion transformers into few-step causal models has become a common approach for streaming video generation. While these few-step stude…
Sparse Forcing: Native Trainable Sparse Attention for Real-time Autoregressive Diffusion Video Generation
Boxun Xu, Yuming Du, Zichang Liu +7
We introduce Sparse Forcing, a training-and-inference paradigm for autoregressive video diffusion models that improves long-horizon generation quality while reducing decoding laten…
SneakPeek: Future-Guided Instructional Streaming Video Generation
Cheeun Hong, German Barquero, Fadime Sener +6
Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad imp…
Autoregressive Distillation of Diffusion Transformers
Yeongmin Kim, Sotiris Anagnostidis, Yuming Du +6
Diffusion models with transformer architectures have demonstrated promising capabilities in generating high-fidelity images and scalability for high resolution. However, iterative…
Movie Gen: A Cast of Media Foundation Models
Adam Polyak, Amit Zohar, Andrew Brown +85
We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabili…
Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation
Jonas Kohler, Albert Pumarola, Edgar Schönfeld +4
Diffusion models are a powerful generative framework, but come with expensive inference. Existing acceleration methods often compromise image quality or fail under complex conditio…
Animated Stickers: Bringing Stickers to Life with Video Diffusion
David Yan, Winnie Zhang, Luxin Zhang +15
We introduce animated stickers, a video diffusion model which generates an animation conditioned on a text prompt and static sticker image. Our model is built on top of the state-o…
fMPI: Fast Novel View Synthesis in the Wild with Layered Scene Representations
Jonas Kohler, Nicolas Griffiths Sanchez, Luca Cavalli +4
In this study, we propose two novel input processing paradigms for novel view synthesis (NVS) methods based on layered scene representations that significantly improve their runtim…