49 citations · 114 across the 8 of their papers we have counts for
9 papers
A Cross Community Agenda for Speech AI
Maria Teleki, Kimi Wenzel, Anna Seo Gyeong Choi +20
Speech AI, any AI system that recognizes, transforms, or generates speech, is built and evaluated across two communities with only a small overlap: technical natural language proce…
Bootstrapping Sign Language Annotations with Sign Language Models
Colin Lea, Vasileios Baltatzis, Connor Gillis +3
AI-driven sign language interpretation is limited by a lack of high-quality annotated data. New datasets including ASL STEM Wiki and FLEURS-ASL contain professional interpreters an…
EmoSign: A Multimodal Dataset for Understanding Emotions in American Sign Language
Phoebe Chua, Cathy Mengying Fang, Takehiko Ohkawa +3
Unlike spoken languages where the use of prosodic features to convey emotion is well studied, indicators of emotion in sign language remain poorly understood, creating communicatio…
Live Captions in Virtual Reality (VR)
Pranav Pidathala, Dawson Franz, James Waller +2
Few VR applications and games implement captioning of speech and audio cues, which either inhibits or prevents access of their application by deaf or hard of hearing (DHH) users, n…
Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning
Emma J. McDonnell, Ping Liu, Steven M. Goodman +3
Real-time captioning is a critical accessibility tool for many d/Deaf and hard of hearing (DHH) people. While the vast majority of captioning work has focused on formal settings an…
Legibility of Videos with ASL signers
Raja S. Kushalnagar
The viewing size of a signer correlates with legibility, i.e., the ease with which a viewer can recognize individual signs. The WCAG 2.0 guidelines (G54) mention in the notes that…
RTTD-ID: Tracked Captions with Multiple Speakers for Deaf Students
Raja Kushalnagar, Gary Behm, Kevin Wolfe +5
Students who are deaf and hard of hearing cannot hear in class and do not have full access to spoken information. They can use accommodations such as captions that display speech a…
Deaf, Hard of Hearing, and Hearing Perspectives on using Automatic Speech Recognition in Conversation
Abraham Glasser, Kesavan Kushalnagar, Raja Kushalnagar
Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce costs and interactive friction, supported by the rapid growth in…
Feasibility of Using Automatic Speech Recognition with Voices of Deaf and Hard-of-Hearing Individuals
Abraham Glasser, Kesavan Kushalnagar, Raja Kushalnagar
Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce device costs and interactive friction. This transition has been…