Feasibility of Using Automatic Speech Recognition with Voices of Deaf and Hard-of-Hearing Individuals

Abstract

Many personal devices have transitioned from visual-controlled interfaces to speech-controlled interfaces to reduce device costs and interactive friction. This transition has been hastened by the increasing capabilities of speech-controlled interfaces, e.g., Amazon Echo or Apple's Siri. A consequence is that people who are deaf or hard of hearing (DHH) may be unable to use these speech-controlled devices. We show that deaf speech has a high error rate compared to hearing speech, in commercial speech-controlled interfaces. Deaf speech had approximately a 78% word error rate (WER) compared to a hearing speech 18% WER. Our findings show that current speech-controlled interfaces are not usable by deaf and hard of hearing people. Therefore, it might be wise to pursue other methods for deaf persons to deliver natural commands to computers.

arXiv comment2 pages, 3 figures

Cited by in corpus (4)

• Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning
• MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
• Deaf, Hard of Hearing, and Hearing Perspectives on using Automatic Speech Recognition in Conversation
• Automatic Speech Recognition Services: Deaf and Hard-of-Hearing Usability