4 papers
Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
Liao Shen, Wentao Jiang, Yiran Zhu +4
Recent advances in image-to-video (I2V) generation have achieved remarkable progress in synthesizing high-quality, temporally coherent videos from static images. Among all the appl…
VC4VG: Optimizing Video Captions for Text-to-Video Generation
Yang Du, Zhuoran Lin, Kaiqiang Song +5
Recent advances in text-to-video (T2V) generation highlight the critical role of high-quality video-text pairs in training models capable of producing coherent and instruction-alig…
Discovering "Words" in Music: Unsupervised Learning of Compositional Sparse Code for Symbolic Music
Tianle Wang, Sirui Zhang, Xinyi Tong +12
This paper presents an unsupervised machine learning algorithm that identifies recurring patterns -- referred to as ``music-words'' -- from symbolic music data. These patterns are…
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline
Dingyi Yang, Chunru Zhan, Ziheng Wang +4
Video storytelling is engaging multimedia content that utilizes video and its accompanying narration to attract the audience, where a key challenge is creating narrations for recor…