33 citations · 59 across the 8 of their papers we have counts for
8 papers
V2Meow: Meowing to the Visual Beat via Video-to-Music Generation
Kun Su, Judith Yue Li, Qingqing Huang +8
Video-to-music generation demands both a temporally localized high-quality listening experience and globally aligned video-acoustic signatures. While recent music generation models…
Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos
Kun Su, Kaizhi Qian, Eli Shlizerman +2
Modeling sounds emitted from physical object interactions is critical for immersive perceptual experiences in real and virtual worlds. Traditional methods of impact sound synthesis…
Incremental Learning Meets Transfer Learning: Application to Multi-site Prostate MRI Segmentation
Chenyu You, Jinlin Xiang, Kun Su +5
Many medical datasets have recently been created for medical image segmentation tasks, and it is natural to question whether we can use them to sequentially train a single model th…
Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements
Kun Su, Xiulong Liu, Eli Shlizerman
We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting. Learning to generate mult…
Audeo: Audio Generation for a Silent Performance Video
Kun Su, Xiulong Liu, Eli Shlizerman
We present a novel system that gets as an input video frames of a musician playing the piano and generates the music for that video. Generation of music from visual cues is a chall…
BI-MAML: Balanced Incremental Approach for Meta Learning
Yang Zheng, Jinlin Xiang, Kun Su +1
We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt i…