5 papers
Spatial Audio Question Answering and Reasoning on Dynamic Source Movements
Arvind Krishna Sridhar, Yinyi Guo, Erik Visser
Spatial audio understanding aims to enable machines to interpret complex auditory scenes, particularly when sound sources move over time. In this work, we study Spatial Audio Quest…
Spatial Audio Motion Understanding and Reasoning
Arvind Krishna Sridhar, Yinyi Guo, Erik Visser
Spatial audio reasoning enables machines to interpret auditory scenes by understanding events and their spatial attributes. In this work, we focus on spatial audio understanding wi…
Comprehensive Audio Query Handling System with Integrated Expert Models and Contextual Understanding
Vakada Naveen, Arvind Krishna Sridhar, Yinyi Guo +1
This paper presents a comprehensive chatbot system designed to handle a wide range of audio-related queries by integrating multiple specialized audio processing models. The propose…
Resource-Efficient Reference-Free Evaluation of Audio Captions
Rehana Mahfuz, Yinyi Guo, Erik Visser
To establish the trustworthiness of systems that automatically generate text captions for audio, images and video, existing reference-free metrics rely on large pretrained models w…
Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models
Arvind Krishna Sridhar, Yinyi Guo, Erik Visser
The Audio Question Answering (AQA) task includes audio event classification, audio captioning, and open-ended reasoning. Recently, AQA has garnered attention due to the advent of L…