8 citations · 40 across the 27 of their papers we have counts for
10 papers · 1 filter
VidMusician: Video-to-Music Generation with Semantic-Rhythmic Alignment via Hierarchical Visual Features
Sifei Li, Binxin Yang, Chunji Yin +4
Video-to-music generation presents significant potential in video production, requiring the generated music to be both semantically and rhythmically aligned with the video. Achievi…
Z-STAR+: A Zero-shot Style Transfer Method via Adjusting Style Distribution
Yingying Deng, Xiangyu He, Fan Tang +1
Style transfer presents a significant challenge, primarily centered on identifying an appropriate style representation. Conventional methods employ style loss, derived from second-…
LumiSculpt: Enabling Consistent Portrait Lighting in Video Generation
Yuxin Zhang, Dandan Zheng, Biao Gong +5
Lighting plays a pivotal role in ensuring the naturalness and aesthetic quality of video generation. However, the impact of lighting is deeply coupled with other factors of videos,…
A Comprehensive Review of Few-shot Action Recognition
Yuyang Wanyan, Xiaoshan Yang, Weiming Dong +1
Few-shot action recognition aims to address the high cost and impracticality of manually labeling complex and variable video data in action recognition. It requires accurately clas…
Revealing the Two Sides of Data Augmentation: An Asymmetric Distillation-based Win-Win Solution for Open-Set Recognition
Yunbing Jia, Xiaoyu Kong, Fan Tang +3
In this paper, we reveal the two sides of data augmentation: enhancements in closed-set recognition correlate with a significant decrease in open-set recognition. Through empirical…
Break-for-Make: Modular Low-Rank Adaptations for Composable Content-Style Customization
Yu Xu, Fan Tang, Juan Cao +5
Personalized generation paradigms empower designers to customize visual intellectual properties with the help of textual descriptions by tuning or adapting pre-trained text-to-imag…
Music Style Transfer with Time-Varying Inversion of Diffusion Models
Sifei Li, Yuxin Zhang, Fan Tang +3
With the development of diffusion models, text-guided image style transfer has demonstrated high-quality controllable synthesis results. However, the utilization of text for divers…
MotionCrafter: One-Shot Motion Customization of Diffusion Models
Yuxin Zhang, Fan Tang, Nisha Huang +4
The essence of a video lies in its dynamic motions, including character actions, object movements, and camera movements. While text-to-video generative diffusion models have recent…
Dance-to-Music Generation with Encoder-based Textual Inversion
Sifei Li, Weiming Dong, Yuxin Zhang +5
The seamless integration of music with dance movements is essential for communicating the artistic intent of a dance piece. This alignment also significantly improves the immersive…
CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion
Nisha Huang, Weiming Dong, Yuxin Zhang +6
Although remarkable progress has been made in image style transfer, style is just one of the components of artistic paintings. Directly transferring extracted style features to nat…