7 citations · 13 across the 11 of their papers we have counts for
13 papers
AMemOps: Evaluating Memory Updates in Long Audio Streams
Peiwei Chang, Li Zhang, Mark D. Plumbley +2
Audio memory must recognise recurring sources across acoustic changes while keeping their attributes up to date. Overall accuracy does not reveal how these demands interact. We int…
Visually-Guided Spatial Audio Generation for In-the-Wild Speech Scenes
Qingyu Luo, Peng Zhang, Wenwu Wang +1
Spatial audio is a key component of immersive media, yet high-quality spatial capture remains limited in real-world speech-dominant scenes. We study visually guided Fir…
Quantifying the Uncertainty of Blindly Estimated Room Embeddings Using a Dispersion-Calibrated Score
Yang Xiang, Philipp Götz, Emanuël A. P. Habets +3
Room embeddings derived from reverberant speech are often unreliable: speech content and recording degradation can alter the representation even when speaker, room, and source-rece…
Grammar-Guided Hierarchical Parsing for Long-form Audio Activity Recognition
Peng Zhang, Qingyu Luo, Philip J. B. Jackson +1
Long-form audio exhibits an inherent hierarchy: fine-grained events form sub-activities, which in turn constitute higher-level activities. Prior work often models these levels sepa…
ToS: A Team of Specialists ensemble framework for Stereo Sound Event Localization and Detection with distance estimation in Video
Davide Berghi, Philip J. B. Jackson
Sound event localization and detection with distance estimation (3D SELD) in video involves identifying active sound events at each time frame while estimating their spatial coordi…
Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videos
Davide Berghi, Philip J. B. Jackson
In this study, we address the multimodal task of stereo sound event localization and detection with source distance estimation (3D SELD) in regular video content. 3D SELD is a comp…
Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos
Davide Berghi, Philip J. B. Jackson
This report presents our systems submitted to the audio-only and audio-visual tracks of the DCASE2025 Task 3 Challenge: Stereo Sound Event Localization and Detection (SELD) in Regu…
Reverberation-based Features for Sound Event Localization and Detection with Distance Estimation
Davide Berghi, Philip J. B. Jackson
Sound event localization and detection (SELD) involves predicting active sound event classes over time while estimating their positions. The localization subtask in SELD is usually…
Leveraging Reverberation and Visual Depth Cues for Sound Event Localization and Detection with Distance Estimation
Davide Berghi, Philip J. B. Jackson
This report describes our systems submitted for the DCASE2024 Task 3 challenge: Audio and Audiovisual Sound Event Localization and Detection with Source Distance Estimation (Track…
Audio-Visual Talker Localization in Video for Spatial Sound Reproduction
Davide Berghi, Philip J. B. Jackson
Object-based audio production requires the positional metadata to be defined for each point-source object, including the key elements in the foreground of the sound scene. In many…
Leveraging Visual Supervision for Array-based Active Speaker Detection and Localization
Davide Berghi, Philip J. B. Jackson
Conventional audio-visual approaches for active speaker detection (ASD) typically rely on visually pre-extracted face tracks and the corresponding single-channel audio to find the…
Fusion of Audio and Visual Embeddings for Sound Event Localization and Detection
Davide Berghi, Peipei Wu, Jinzheng Zhao +2
Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only…
Audio-Visual Speaker Tracking: Progress, Challenges, and Future Directions
Jinzheng Zhao, Yong Xu, Xinyuan Qian +6
Audio-visual speaker tracking has drawn increasing attention over the past few years due to its academic values and wide applications. Audio and visual modalities can provide compl…