2 citations · 5 across the 22 of their papers we have counts for
8 papers · 1 filter
AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
Xilin Jiang, Qiaolin Wang, Junkai Wu +30
Internet audio-visual clips convey meaning through time-varying sound and motion, which extend beyond what text alone can represent. To examine whether AI models can understand suc…
Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation
Chen Si, Qianyi Wu, Chaitanya Amballa +1
Realistic sound simulation plays a critical role in many applications. A key element in sound simulation is the room impulse response (RIR), which characterizes how sound propagate…
Unsupervised Multi-channel Speech Dereverberation via Diffusion
Yulun Wu, Zhongweiyang Xu, Jianchong Chen +2
We consider the problem of multi-channel single-speaker blind dereverberation, where multi-channel mixtures are used to recover the clean anechoic speech. To solve this problem, we…
Sample-Constrained Black Box Optimization for Audio Personalization
Rajalaxmi Rajagopalan, Yu-Lin Wei, Romit Roy Choudhury
We consider the problem of personalizing audio to maximize user experience. Briefly, we aim to find a filter , which applied to any music or speech, will maximize the user's s…
Learning to Separate Voices by Spatial Regions
Zhongweiyang Xu, Romit Roy Choudhury
We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $…
RoSS: Utilizing Robotic Rotation for Audio Source Separation
Hyungjoo Seo, Sahil Bhandary Karnoor, Romit Roy Choudhury
This paper considers the problem of audio source separation where the goal is to isolate a target audio signal (say Alice's speech) from a mixture of multiple interfering signals (…
Inferring Facing Direction from Voice Signals
Yu-Lin Wei, Rui Li, Abhinav Mehrotra +2
Consider a home or office where multiple devices are running voice assistants (e.g., TVs, lights, ovens, refrigerators, etc.). A human user turns to a particular device and gives a…
Estimating Angle of Arrival (AoA) of multiple Echoes in a Steering Vector Space
Yu-Lin Wei, Romit Roy Choudhury
Consider a microphone array, such as those present in Amazon Echos, conference phones, or self-driving cars. One of the goals of these arrays is to decode the angles in which acous…