5 papers · 1 filter
Probing Spatial Structure in Pretrained Audio Representations
Chuyang Chen, Sivan Ding, Adrian S. Roman +1
Pretrained spatial audio encoders are increasingly used as general-purpose representations for perceptual tasks, yet their spatial encoding capabilities remain poorly understood. W…
Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach
Adrian S. Roman, Iran R. Roman, Juan P. Bello
Acoustic mapping techniques have long been used in spatial audio processing for direction of arrival estimation (DoAE). Traditional beamforming methods for acoustic mapping, while…
Generating Diverse Audio-Visual 360 Soundscapes for Sound Event Localization and Detection
Adrian S. Roman, Aiden Chang, Gerardo Meza +1
We present SELDVisualSynth, a tool for generating synthetic videos for audio-visual sound event localization and detection (SELD). Our approach incorporates real-world background i…
Enhanced Sound Event Localization and Detection in Real 360-degree audio-visual soundscapes
Adrian S. Roman, Baladithya Balamurugan, Rithik Pothuganti
This technical report details our work towards building an enhanced audio-visual sound event localization and detection (SELD) network. We build on top of the audio-only SELDnet23…
Robust DOA estimation using deep acoustic imaging
Adrian S. Roman, Iran R. Roman, Juan P. Bello
Direction of arrival estimation (DoAE) aims at tracking a sound in azimuth and elevation. Recent advancements include data-driven models with inputs derived from ambisonics intensi…