8 papers
TRACE: Object Motion Editing in Videos with First-Frame Trajectory Guidance
Quynh Phung, Long Mai, Cusuh Ham +3
We study object motion path editing in videos, where the goal is to alter a target object's trajectory while preserving the original scene content. Unlike prior video editing metho…
DreamLoop: Controllable Cinemagraph Generation from a Single Photograph
Aniruddha Mahapatra, Long Mai, Cusuh Ham +1
Cinemagraphs, which combine static photographs with selective, looping motion, offer unique artistic appeal. Generating them from a single photograph in a controllable manner is pa…
Progressive Growing of Video Tokenizers for Temporally Compact Latent Spaces
Aniruddha Mahapatra, Long Mai, David Bourgin +2
Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extendin…
Diffusion Transformer-to-Mamba Distillation for High-Resolution Image Generation
Yuan Yao, Yicong Hong, Difan Liu +3
The quadratic computational complexity of self-attention in diffusion transformers (DiT) introduces substantial computational costs in high-resolution image generation. While the l…
CineVerse: Consistent Keyframe Synthesis for Cinematic Scene Composition
Quynh Phung, Long Mai, Fabian David Caba Heilbron +3
We present CineVerse, a novel framework for the task of cinematic scene composition. Similar to traditional multi-shot generation, our task emphasizes the need for consistency and…
REGEN: Learning Compact Video Embedding with (Re-)Generative Decoder
Yitian Zhang, Long Mai, Aniruddha Mahapatra +5
We present a novel perspective on learning video embedders for generative modeling: rather than requiring an exact reproduction of an input video, an effective embedder should focu…