24 citations · 26 across the 7 of their papers we have counts for
7 papers
MSU-Bench: Towards Speaker-Centric Understanding in Conversational Multi-Speaker Scenarios
Zhaokai Sun, Shuai Wang, Zhennan Lin +6
Spoken Language Understanding (SLU) is moving from task-specific pipelines toward large audio language models (LALMs) that generate natural-language responses. However, existing sp…
Towards Robust Overlapping Speech Detection: A Speaker-Aware Progressive Approach Using WavLM
Zhaokai Sun, Li Zhang, Qing Wang +2
Overlapping Speech Detection (OSD) aims to identify regions where multiple speakers overlap in a conversation, a critical challenge in multi-party speech processing. This work prop…
The NPU-ASLP-LiAuto System Description for Visual Speech Recognition in CNVSRC 2023
He Wang, Pengcheng Guo, Wei Chen +2
This paper delineates the visual speech recognition (VSR) system introduced by the NPU-ASLP-LiAuto (Team 237) in the first Chinese Continuous Visual Speech Recognition Challenge (C…
ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challenge
He Wang, Pengcheng Guo, Yue Li +13
To promote speech processing and recognition research in driving scenarios, we build on the success of the Intelligent Cockpit Speech Recognition Challenge (ICSRC) held at ISCSLP 2…
MLCA-AVSR: Multi-Layer Cross Attention Fusion based Audio-Visual Speech Recognition
He Wang, Pengcheng Guo, Pan Zhou +1
While automatic speech recognition (ASR) systems degrade significantly in noisy environments, audio-visual speech recognition (AVSR) systems aim to complement the audio stream with…
U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias
Ao Zhang, Pan Zhou, Kaixun Huang +3
Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and p…
Automatic channel selection and spatial feature integration for multi-channel speech recognition across various array topologies
Bingshen Mu, Pengcheng Guo, Dake Guo +3
Automatic Speech Recognition (ASR) has shown remarkable progress, yet it still faces challenges in real-world distant scenarios across various array topologies each with multiple r…