2 citations · 4 across the 7 of their papers we have counts for
7 papers
High-Quality Sound Separation Across Diverse Categories via Visually-Guided Generative Modeling
Chao Huang, Susan Liang, Yapeng Tian +2
We propose DAVIS, a Diffusion-based Audio-VIsual Separation framework that solves the audio-visual sound source separation task through generative learning. Existing methods typica…
FreSca: Scaling in Frequency Space Enhances Diffusion Models
Chao Huang, Susan Liang, Yunlong Tang +4
Latent diffusion models (LDMs) have achieved remarkable success in a variety of image tasks, yet achieving fine-grained, disentangled control over global structures versus fine det…
Language-Guided Joint Audio-Visual Editing via One-Shot Adaptation
Susan Liang, Chao Huang, Yapeng Tian +2
In this paper, we introduce a novel task called language-guided joint audio-visual editing. Given an audio and image pair of a sounding event, this task aims at generating new audi…
Scaling Concept With Text-Guided Diffusion Models
Chao Huang, Susan Liang, Yunlong Tang +3
Text-guided diffusion models have revolutionized generative tasks by producing high-fidelity content from text descriptions. They have also enabled an editing paradigm where concep…
OSCaR: Object State Captioning and State Change Representation
Nguyen Nguyen, Jing Bi, Ali Vosoughi +3
The capability of intelligent models to extrapolate and comprehend changes in object states is a crucial yet demanding aspect of AI research, particularly through the lens of human…
Efficiently Leveraging Linguistic Priors for Scene Text Spotting
Nguyen Nguyen, Yapeng Tian, Chenliang Xu
Incorporating linguistic knowledge can improve scene text recognition, but it is questionable whether the same holds for scene text spotting, which typically involves text detectio…
Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoning
Changsheng Lv, Shuai Zhang, Yapeng Tian +2
In this paper, we propose a Disentangled Counterfactual Learning~(DCL) approach for physical audiovisual commonsense reasoning. The task aims to infer objects' physics commonsense…