most citedDirect-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion

36 citations · 39 across the 10 of their papers we have counts for

collaborators

10 papers

cs.CV2024

Owl-1: Omni World Model for Consistent Long Video Generation

Yuanhui Huang, Wenzhao Zheng, Yuan Gao +5

Video generation models (VGMs) have received extensive attention recently and serve as promising candidates for general-purpose large vision models. While they can only generate sh…

cs.CV2024

Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content

Qiuheng Wang, Yukai Shi, Jiarong Ou +10

With the continuous progress of visual generation technologies, the scale of video datasets has grown exponentially. The quality of these datasets plays a pivotal role in the perfo…

cs.CV2024

Towards Unified 3D Hair Reconstruction from Single-View Portraits

Yujian Zheng, Yuda Qiu, Leyang Jin +5

Single-view 3D hair reconstruction is challenging, due to the wide range of shape variations among diverse hairstyles. Current state-of-the-art methods are specialized in recoverin…

cs.CV2024

ViMo: Generating Motions from Casual Videos

Liangdong Qiu, Chengxing Yu, Yanran Li +6

Although humans have the innate ability to imagine multiple possible actions from videos, it remains an extraordinary challenge for computers due to the intricate camera movements…

cs.CV2024

A-SDM: Accelerating Stable Diffusion through Model Assembly and Feature Inheritance Strategies

Jinchao Zhu, Yuxuan Wang, Siyuan Pan +3

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, m…

cs.CV2024★ 1 cited

VideoTetris: Towards Compositional Text-to-Video Generation

Ye Tian, Ling Yang, Haotian Yang +9

Diffusion models have demonstrated great success in text-to-video (T2V) generation. However, existing methods may face challenges when handling complex (long) video generation scen…

cs.CV2024★ 1 cited

UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmark

Zhaokun Zhou, Qiulin Wang, Bin Lin +7

As an alternative to expensive expert evaluation, Image Aesthetic Assessment (IAA) stands out as a crucial task in computer vision. However, traditional IAA methods are typically c…

cs.CV2024

Motion Inversion for Video Customization

Luozhou Wang, Ziyang Mai, Guibao Shen +6

In this work, we present a novel approach for motion customization in video generation, addressing the widespread gap in the exploration of motion representation within video gener…

cs.CV2024★ 36 cited

Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion

Shiyuan Yang, Liang Hou, Haibin Huang +5

Recent text-to-video diffusion models have achieved impressive progress. In practice, users often desire the ability to control object motion and camera movement independently for…

cs.CV2023★ 1 cited

I2V-Adapter: A General Image-to-Video Adapter for Diffusion Models

Xun Guo, Mingwu Zheng, Liang Hou +9

Text-guided image-to-video (I2V) generation aims to generate a coherent video that preserves the identity of the input image and semantically aligns with the input prompt. Existing…