activity
20182026
most citedIs Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection

132 citations · 272 across the 54 of their papers we have counts for

collaborators
Showing 2024 · eess.ASShow all

11 papers · 2 filters

eess.AS2024

XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection

Yang Xiao, Rohan Kumar Das

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one no…

eess.AS2024

Leveraging LLM and Text-Queried Separation for Noise-Robust Sound Event Detection

Han Yin, Yang Xiao, Jisheng Bai +1

Sound Event Detection (SED) is challenging in noisy environments where overlapping sounds obscure target events. Language-queried audio source separation (LASS) aims to isolate the…

eess.AS2024

Exploring Text-Queried Sound Event Detection with Audio Source Separation

Han Yin, Jisheng Bai, Yang Xiao +6

In sound event detection (SED), overlapping sound events pose a significant challenge, as certain events can be easily masked by background noise or other events, resulting in poor…

eess.AS2024

TF-Mamba: A Time-Frequency Network for Sound Source Localization

Yang Xiao, Rohan Kumar Das

Sound source localization (SSL) determines the position of sound sources using multi-channel audio data. It is commonly used to improve speech enhancement and separation. Extractin…

eess.AS2024★ 2 cited

Where's That Voice Coming? Continual Learning for Sound Source Localization

Yang Xiao, Rohan Kumar Das

Sound source localization (SSL) is essential for many speech-processing applications. Deep learning models have achieved high performance, but often fail when the training and infe…

eess.AS2024

UCIL: An Unsupervised Class Incremental Learning Approach for Sound Event Detection

Yang Xiao, Rohan Kumar Das

This work explores class-incremental learning (CIL) for sound event detection (SED), advancing adaptability towards real-world scenarios. CIL's success in domains like computer vis…

eess.AS2024

WildDESED: An LLM-Powered Dataset for Wild Domestic Environment Sound Event Detection System

Yang Xiao, Rohan Kumar Das

This work aims to advance sound event detection (SED) research by presenting a new large language model (LLM)-powered dataset namely wild domestic environment sound event detection…

eess.AS2024★ 1 cited

DG-SED: Domain Generalization for Sound Event Detection with Heterogeneous Training Data

Yang Xiao, Han Yin, Jisheng Bai +1

This work explores domain generalization (DG) for sound event detection (SED), advancing adaptability to real-world scenarios. Our approach employs a mean-teacher framework with do…

eess.AS2024

FMSG-JLESS Submission for DCASE 2024 Task4 on Sound Event Detection with Heterogeneous Training Dataset and Potentially Missing Labels

Yang Xiao, Han Yin, Jisheng Bai +1

This report presents the systems developed and submitted by Fortemedia Singapore (FMSG) and Joint Laboratory of Environmental Sound Sensing (JLESS) for DCASE 2024 Task 4. The task…

eess.AS2024

How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio?

Tianchi Liu, Lin Zhang, Rohan Kumar Das +3

Partially manipulating a sentence can greatly change its meaning. Recent work shows that countermeasures (CMs) trained on partially spoofed audio can effectively detect such spoofi…

eess.AS2024

Enhancing Real-World Active Speaker Detection with Multi-Modal Extraction Pre-Training

Ruijie Tao, Xinyuan Qian, Rohan Kumar Das +3

Audio-visual active speaker detection (AV-ASD) aims to identify which visible face is speaking in a scene with one or more persons. Most existing AV-ASD methods prioritize capturin…