3 citations · 5 across the 9 of their papers we have counts for
10 papers
MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
Sonal Kumar, Šimon Sedláček, Vaibhavi Lokegaonkar +31
Audio comprehension-including speech, non-speech sounds, and music-is essential for achieving human-level intelligence. Consequently, AI agents must demonstrate holistic audio unde…
Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speech
Lavanya Shankar, Leibny Paola Garcia Perera
Code-switching and language identification in child-directed scenarios present significant challenges, particularly in bilingual environments. This paper addresses this challenge b…
CASPER: A Large Scale Spontaneous Speech Dataset
Cihan Xiao, Ruixing Liang, Xiangyu Zhang +8
The success of large language models has driven interest in developing similar speech processing capabilities. However, a key challenge is the scarcity of high-quality spontaneous…
SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model
Xinyuan Qian, Jiaran Gao, Yaodan Zhang +4
Speech enhancement plays an essential role in various applications, and the integration of visual information has been demonstrated to bring substantial advantages. However, the ma…
Learning from Flawed Data: Weakly Supervised Automatic Speech Recognition
Dongji Gao, Hainan Xu, Desh Raj +3
Training automatic speech recognition (ASR) systems requires large amounts of well-curated paired data. However, human annotators usually perform "non-verbatim" transcription, whic…
MERLIon CCS Challenge Evaluation Plan
Leibny Paola Garcia Perera, Y. H. Victoria Chua, Hexin Liu +5
This paper introduces the inaugural Multilingual Everyday Recordings- Language Identification on Code-Switched Child-Directed Speech (MERLIon CCS) Challenge, focused on developing…