activity
20232026
most citedThe Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction

1 citations · 2 across the 11 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

eess.AS2024★ 1 cited

DCF-DS: Deep Cascade Fusion of Diarization and Separation for Speech Recognition under Realistic Single-Channel Conditions

Shu-Tong Niu, Jun Du, Ruo-Yu Wang +4

We propose a single-channel Deep Cascade Fusion of Diarization and Separation (DCF-DS) framework for back-end automatic speech recognition (ASR), combining neural speaker diarizati…

eess.AS2024

Incorporating Spatial Cues in Modular Speaker Diarization for Multi-channel Multi-party Meetings

Ruoyu Wang, Shutong Niu, Gaobin Yang +4

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to…

cs.SD2024

Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

Chang Li, Ruoyu Wang, Lijuan Liu +7

Text-to-music (TTM) generation, which converts textual descriptions into audio, opens up innovative avenues for multimedia creation. Achieving high quality and diversity in this pr…

cs.SD2024

Multitask frame-level learning for few-shot sound event detection

Liang Zou, Genwei Yan, Ruoyu Wang +4

This paper focuses on few-shot Sound Event Detection (SED), which aims to automatically recognize and classify sound events with limited samples. However, prevailing methods method…

cs.SD2024

A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition

Yusheng Dai, Hang Chen, Jun Du +5

Advanced Audio-Visual Speech Recognition (AVSR) systems have been observed to be sensitive to missing video frames, performing even worse than single-modality models. While applyin…