activity
20242026
most citedA Survey on Speech Large Language Models for Understanding

6 citations · 6 across the 15 of their papers we have counts for

collaborators

18 papers

eess.AS2026

SURE-EVAL: A Systematic and Unified Agentic Framework for Reproducible Evaluation

Jing Peng, Junhao Du, Yixuan Wang +21

Audio and speech models are released rapidly, but reported scores often conflate model capability with deployment and evaluation choices. The same checkpoint can produce different…

eess.AS2026

Pruned CTC for Memory-Efficient Large-Vocabulary ASR Training

Yifan Yang, Xiaoyu Yang, Zengrui Jin +10

Connectionist temporal classification (CTC) naturally supports offline and streaming speech recognition with utterance-level supervision, but conventional implementations materiali…

eess.AS2026

DAMSEP: Distance-Aware Monaural Source Separation using Multi-RIR Estimation

Wen Wen, Qiang Zhou, Yu Xi +3

Although room impulse responses (RIRs) encode source-distance cues, conventional monaural source separation focuses on recovering audio content without estimating source-specific R…

eess.AS2026

DiaScriber: A Speech LLM for Joint Diarization and Transcription in Multi-Speaker Scenarios

Bingshen Mu, Xian Shi, Xiong Wang +6

Multi-speaker automatic speech recognition (MSASR) aims to jointly predict content transcriptions, speaker identities, and timestamps, thereby addressing the key question of "who s…

eess.AS2026

Audio-Mind: An Auditable Agentic Framework for Audio Understanding

Yucheng Wang, Jing Peng, Hanqi Li +6

Audio agents extend large audio-language models (LALMs) by decomposing audio questions into tool calls, intermediate evidence, and iterative reasoning steps. However, as LALMs beco…

cs.SD2026

HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding

Bohan Li, Shi Lian, Hankun Wang +6

Unified speech foundation models require a holistic tokenization space that is both learnable by language models and decodable into high-quality waveforms. Existing speech tokenize…

eess.AS2026

Detect, Attend and Extract: Keyword Guided Target Speaker Extraction

Haoyu Li, Yu Xi, Yidi Jiang +5

Target speaker extraction (TSE) aims to extract the speech of a target speaker from mixtures containing multiple competing speakers. Conventional TSE systems predominantly rely on…

cs.AI2025

Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics

Yueqing Xi, Yifan Bai, Huasen Luo +3

As artificial intelligence permeates judicial forensics, ensuring the veracity and traceability of legal question answering (QA) has become critical. Conventional large language mo…

eess.AS2025

Time-Layer Adaptive Alignment for Speaker Similarity in Flow-Matching Based Zero-Shot TTS

Haoyu Li, Mingyang Han, Yu Xi +8

Flow-Matching (FM)-based zero-shot text-to-speech (TTS) systems exhibit high-quality speech synthesis and robust generalization capabilities. However, the speaker representation ab…

eess.AS2025

MFA-KWS: Effective Keyword Spotting with Multi-head Frame-asynchronous Decoding

Yu Xi, Haoyu Li, Xiaoyu Gu +2

Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explor…

cs.SD2025

Masked Self-distilled Transducer-based Keyword Spotting with Semi-autoregressive Decoding

Yu Xi, Xiaoyu Gu, Haoyu Li +3

RNN-T-based keyword spotting (KWS) with autoregressive decoding~(AR) has gained attention due to its streaming architecture and superior performance. However, the simplicity of the…

eess.AS2024

Neural Directed Speech Enhancement with Dual Microphone Array in High Noise Scenario

Wen Wen, Qiang Zhou, Yu Xi +3

In multi-speaker scenarios, leveraging spatial features is essential for enhancing target speech. While with limited microphone arrays, developing a compact multi-channel speech en…

eess.AS2024

Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistency

Yu Xi, Haoyu Li, Xiaoyu Gu +3

Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding stra…

eess.AS2024

NTC-KWS: Noise-aware CTC for Robust Keyword Spotting

Yu Xi, Haoyu Li, Hao Li +4

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They a…

eess.AS2024★ 6 cited

A Survey on Speech Large Language Models for Understanding

Jing Peng, Yucheng Wang, Bohan Li +9

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that…

eess.AS2024

Text-aware Speech Separation for Multi-talker Keyword Spotting

Haoyu Li, Baochen Yang, Yu Xi +4

For noisy environments, ensuring the robustness of keyword spotting (KWS) systems is essential. While much research has focused on noisy KWS, less attention has been paid to multi-…

eess.AS2024

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

Yu Xi, Hao Li, Baochen Yang +3

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Ex…

eess.AS2024

Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speech

Yu Xi, Baochen Yang, Hao Li +2

Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been wi…