7 citations · 16 across the 15 of their papers we have counts for
4 papers · 1 filter
Leveraging Visual Supervision for Array-based Active Speaker Detection and Localization
Davide Berghi, Philip J. B. Jackson
Conventional audio-visual approaches for active speaker detection (ASD) typically rely on visually pre-extracted face tracks and the corresponding single-channel audio to find the…
Fusion of Audio and Visual Embeddings for Sound Event Localization and Detection
Davide Berghi, Peipei Wu, Jinzheng Zhao +2
Sound event localization and detection (SELD) combines two subtasks: sound event detection (SED) and direction of arrival (DOA) estimation. SELD is usually tackled as an audio-only…
Audio-Visual Speaker Tracking: Progress, Challenges, and Future Directions
Jinzheng Zhao, Yong Xu, Xinyuan Qian +6
Audio-visual speaker tracking has drawn increasing attention over the past few years due to its academic values and wide applications. Audio and visual modalities can provide compl…
Audio Inputs for Active Speaker Detection and Localization via Microphone Array
Davide Berghi, Philip J. B. Jackson
This study considers the problem of detecting and locating an active talker's horizontal position from multichannel audio captured by a microphone array. We refer to this as active…