1.4k citations · 1.7k across the 26 of their papers we have counts for
30 papers
Two vs. Four-Channel Sound Event Localization and Detection
Julia Wilkins, Magdalena Fuentes, Luca Bondi +3
Sound event localization and detection (SELD) systems estimate both the direction-of-arrival (DOA) and class of sound sources over time. In the DCASE 2022 SELD Challenge (Task 3),…
Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries
Julia Wilkins, Justin Salamon, Magdalena Fuentes +2
Finding the right sound effects (SFX) to match moments in a video is a difficult and time-consuming task, and relies heavily on the quality and completeness of text metadata. Retri…
Audio-Text Models Do Not Yet Leverage Natural Language
Ho-Hsiang Wu, Oriol Nieto, Juan Pablo Bello +1
Multi-modal contrastive learning techniques in the audio-text domain have quickly become a highly active area of research. Most works are evaluated with standard audio retrieval an…
FlowGrad: Using Motion for Visual Sound Source Localization
Rajsuryan Singh, Pablo Zinemanas, Xavier Serra +2
Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal informatio…
Few-Shot Musical Source Separation
Yu Wang, Daniel Stoller, Rachel M. Bittner +1
Deep learning-based approaches to musical source separation are often limited to the instrument classes that the models are trained on and do not generalize to separate unseen inst…
How to Listen? Rethinking Visual Sound Localization
Ho-Hsiang Wu, Magdalena Fuentes, Prem Seetharaman +1
Localizing visual sounds consists on locating the position of objects that emit sound within an image. It is a growing research area with potential applications in monitoring natur…