4 papers · 1 filter
SURE-EVAL: A Systematic and Unified Agentic Framework for Reproducible Evaluation
Jing Peng, Junhao Du, Yixuan Wang +21
Audio and speech models are released rapidly, but reported scores often conflate model capability with deployment and evaluation choices. The same checkpoint can produce different…
A Unified and Reproducible Experimentation Framework for Speech Understanding
Jing Peng, Junhao Du, Chenghao Wang +21
Speech foundation models and Speech LLMs have advanced speech understanding, yet deployment-oriented model selection is hindered by non-comparable evaluations caused by mismatched…
MFA-KWS: Effective Keyword Spotting with Multi-head Frame-asynchronous Decoding
Yu Xi, Haoyu Li, Xiaoyu Gu +2
Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explor…
Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistency
Yu Xi, Haoyu Li, Xiaoyu Gu +3
Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding stra…