5 papers
Articulation-Informed ASR: Integrating Articulatory Features into ASR via Auxiliary Speech Inversion and Cross-Attention Fusion
Ahmed Adel Attia, Jing Liu, Carol Espy Wilson
Prior works have investigated the use of articulatory features as complementary representations for automatic speech recognition (ASR), but their use was largely confined to shallo…
RealClass: A Framework for Classroom Speech Simulation with Public Datasets and Game Engines
Ahmed Adel Attia, Jing Liu, Carol Espy Wilson
The scarcity of large-scale classroom speech data has hindered the development of AI-driven speech models for education. Classroom datasets remain limited and not publicly availabl…
SimClass: A Classroom Speech Dataset Generated via Game Engine Simulation For Automatic Speech Recognition Research
Ahmed Adel Attia, Jing Liu, Carl Espy-Wilson
The scarcity of large-scale classroom speech data has hindered the development of AI-driven speech models for education. Public classroom datasets remain limited, and the lack of a…
Abstract Sound Fusion with Unconditional Inversion Models
Jing Liu, Enqi Lian, Moyao Deng
An abstract sound is defined as a sound that does not disclose identifiable real-world sound events to a listener. Sound fusion aims to synthesize an original sound and a reference…
FT-Boosted SV: Towards Noise Robust Speaker Verification for English Speaking Classroom Environments
Saba Tabatabaee, Jing Liu, Carol Espy-Wilson
Creating Speaker Verification (SV) systems for classroom settings that are robust to classroom noises such as babble noise is crucial for the development of AI tools that assist ed…