7 papers
Probing Spatial Structure in Pretrained Audio Representations
Chuyang Chen, Sivan Ding, Adrian S. Roman +1
Pretrained spatial audio encoders are increasingly used as general-purpose representations for perceptual tasks, yet their spatial encoding capabilities remain poorly understood. W…
Sensitivity Analysis of Generative Spatial Audio Metrics: A Study on Responsiveness, Smoothness, and Symmetry
Purnima Kamath, Adrian S. Roman, Koichi Saito +2
Evaluating generative spatial audio for First-Order Ambisonics (FOA) remains challenging due to a limited understanding of how metrics respond to changes in spatial parameters such…
Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach
Adrian S. Roman, Iran R. Roman, Juan P. Bello
Acoustic mapping techniques have long been used in spatial audio processing for direction of arrival estimation (DoAE). Traditional beamforming methods for acoustic mapping, while…
Generating Diverse Audio-Visual 360 Soundscapes for Sound Event Localization and Detection
Adrian S. Roman, Aiden Chang, Gerardo Meza +1
We present SELDVisualSynth, a tool for generating synthetic videos for audio-visual sound event localization and detection (SELD). Our approach incorporates real-world background i…
Enhanced Sound Event Localization and Detection in Real 360-degree audio-visual soundscapes
Adrian S. Roman, Baladithya Balamurugan, Rithik Pothuganti
This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23…
Spatial Scaper: A Library to Simulate and Augment Soundscapes for Sound Event Localization and Detection in Realistic Rooms
Iran R. Roman, Christopher Ick, Sivan Ding +3
Sound event localization and detection (SELD) is an important task in machine listening. Major advancements rely on simulated data with sound events in specific rooms and strong sp…
Robust DOA estimation using deep acoustic imaging
Adrian S. Roman, Iran R. Roman, Juan P. Bello
Direction of arrival estimation (DoAE) aims at tracking a sound in azimuth and elevation. Recent advancements include data-driven models with inputs derived from ambisonics intensi…