9 papers
Speaker Verification Under Real Classroom Conditions for English Speech
Saba Tabatabaee, Jing Liu, Meghavarshini Krishnaswamy +2
Developing speaker verification (SV) models that are robust to classroom noise and effective across both children and adult speakers is critical for AI tools supporting educational…
Multimodal Speaker Identification in Classroom Environments
Michael L. Chrzan, Meghavarshini Krishnaswamy, Robert Gibboni +3
Automated analysis of K-12 classroom dynamics faces challenges due to background noise and variable child speech, often confounding acoustic-only models. This study evaluates a mul…
Articulation-Informed ASR: Integrating Articulatory Features into ASR via Auxiliary Speech Inversion and Cross-Attention Fusion
Ahmed Adel Attia, Jing Liu, Carol Espy Wilson
Prior works have investigated the use of articulatory features as complementary representations for automatic speech recognition (ASR), but their use was largely confined to shallo…
RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines
Ahmed Adel Attia, Jing Liu, Carol Espy Wilson
The scarcity of large-scale classroom speech data has hindered the development of AI-driven speech models for education. Classroom datasets remain limited and not publicly availabl…
Abstract Sound Fusion with Unconditional Inversion Models
Jing Liu, Enqi Lian, Moyao Deng
An abstract sound is defined as a sound that does not disclose identifiable real-world sound events to a listener. Sound fusion aims to synthesize an original sound and a reference…
SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Research
Ahmed Adel Attia, Jing Liu, Carl Espy-Wilson
The scarcity of large-scale classroom speech data has hindered the development of AI-driven speech models for education. Public classroom datasets remain limited, and the lack of a…