10 papers · 1 filter
End-to-End Spoken Grammatical Error Correction
Mengjie Qian, Rao Ma, Stefano Bannò +2
Grammatical Error Correction (GEC) and feedback play a vital role in supporting second language (L2) learners, educators, and examiners. While written GEC is well-established, spok…
Assessment of L2 Oral Proficiency using Speech Large Language Models
Rao Ma, Mengjie Qian, Siyuan Tang +3
The growing population of L2 English speakers has increased the demand for developing automatic graders for spoken language assessment (SLA). Historically, statistical models, text…
Scaling and Prompting for Improved End-to-End Spoken Grammatical Error Correction
Mengjie Qian, Rao Ma, Stefano Bannò +2
Spoken Grammatical Error Correction (SGEC) and Feedback (SGECF) are crucial for second language learners, teachers and test takers. Traditional SGEC systems rely on a cascaded pipe…
Universal Acoustic Adversarial Attacks for Flexible Control of Speech-LLMs
Rao Ma, Mengjie Qian, Vyas Raina +2
The combination of pre-trained speech encoders with large language models has enabled the development of speech LLMs that can handle a wide range of spoken language processing task…
LegoSLM: Connecting LLM with Speech Encoder using CTC Posteriors
Rao Ma, Tongzhou Chen, Kartik Audhkhasi +1
Recently, large-scale pre-trained speech encoders and Large Language Models (LLMs) have been released, which show state-of-the-art performance on a range of spoken language process…
Cross-Lingual Transfer Learning for Speech Translation
Rao Ma, Mengjie Qian, Yassir Fathullah +3
There has been increasing interest in building multilingual foundation models for NLP and speech research. This paper examines how to expand the speech translation capability of th…