4 papers
MusicInfuser: Making Video Diffusion Listen and Dance
Susung Hong, Ira Kemelmacher-Shlizerman, Brian Curless +1
We introduce MusicInfuser, an approach that aligns pre-trained text-to-video diffusion models to generate high-quality dance videos synchronized with specified music tracks. Rather…
COMIC: Agentic Sketch Comedy Generation
Susung Hong, Brian Curless, Ira Kemelmacher-Shlizerman +1
We propose a fully automated AI system that produces short comedic videos similar to sketch shows such as Saturday Night Live. Starting with character references, the system employ…
DiffusionBrowser: Interactive Diffusion Previews via Multi-Branch Decoders
Susung Hong, Chongjian Ge, Zhifei Zhang +1
Video diffusion models have revolutionized generative video synthesis, but they are imprecise, slow, and can be opaque during generation -- keeping users in the dark for a prolonge…
Perturb-and-Revise: Flexible 3D Editing with Generative Trajectories
Susung Hong, Johanna Karras, Ricardo Martin-Brualla +1
Recent advancements in text-based diffusion models have accelerated progress in 3D reconstruction and text-based 3D editing. Although existing 3D editing methods excel at modifying…