3 citations · 5 across the 9 of their papers we have counts for
11 papers
ASSET: Adaptive Speech Segmentation via Reinforcement Learning
Cihan Xiao, Yuan Tseng, Matthew Wiesner +4
Speech large language models (LLMs) are often built using pretrained acoustic encoders as an audio interface to an LLM decoder. However, LLMs scale poorly with input sequence lengt…
MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
Sonal Kumar, Šimon Sedláček, Vaibhavi Lokegaonkar +31
Audio comprehension-including speech, non-speech sounds, and music-is essential for achieving human-level intelligence. Consequently, AI agents must demonstrate holistic audio unde…
Leveraging Zipformer Model for Effective Language Identification in Code-Switched Child-Directed Speech
Lavanya Shankar, Leibny Paola Garcia Perera
Code-switching and language identification in child-directed scenarios present significant challenges, particularly in bilingual environments. This paper addresses this challenge b…
CASPER: A Large Scale Spontaneous Speech Dataset
Cihan Xiao, Ruixing Liang, Xiangyu Zhang +8
The success of large language models has driven interest in developing similar speech processing capabilities. However, a key challenge is the scarcity of high-quality spontaneous…
SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model
Xinyuan Qian, Jiaran Gao, Yaodan Zhang +4
Speech enhancement plays an essential role in various applications, and the integration of visual information has been demonstrated to bring substantial advantages. However, the ma…
Learning from Flawed Data: Weakly Supervised Automatic Speech Recognition
Dongji Gao, Hainan Xu, Desh Raj +3
Training automatic speech recognition (ASR) systems requires large amounts of well-curated paired data. However, human annotators usually perform "non-verbatim" transcription, whic…
MERLIon CCS Challenge Evaluation Plan
Leibny Paola Garcia Perera, Y. H. Victoria Chua, Hexin Liu +5
This paper introduces the inaugural Multilingual Everyday Recordings- Language Identification on Code-Switched Child-Directed Speech (MERLIon CCS) Challenge, focused on developing…
Investigating model performance in language identification: beyond simple error statistics
Suzy J. Styles, Victoria Y. H. Chua, Fei Ting Woon +5
Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of…
MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarization
Victoria Y. H. Chua, Hexin Liu, Leibny Paola Garcia Perera +7
To enhance the reliability and robustness of language identification (LID) and language diarization (LD) systems for heterogeneous populations and scenarios, there is a need for sp…
PHO-LID: A Unified Model Incorporating Acoustic-Phonetic and Phonotactic Information for Language Identification
Hexin Liu, Leibny Paola Garcia Perera, Andy W. H. Khong +2
We propose a novel model to hierarchically incorporate phoneme and phonotactic information for language identification (LID) without requiring phoneme annotations for training. In…
Enhance Language Identification using Dual-mode Model with Knowledge Distillation
Hexin Liu, Leibny Paola Garcia Perera, Andy W. H. Khong +3
In this paper, we propose to employ a dual-mode framework on the x-vector self-attention (XSA-LID) model with knowledge distillation (KD) to enhance its language identification (LI…