73 citations · 145 across the 13 of their papers we have counts for
5 papers · 1 filter
Attention-based Audio-Visual Fusion for Robust Automatic Speech Recognition
George Sterpu, Christian Saam, Naomi Harte
Automatic speech recognition can potentially benefit from the lip motion patterns, complementing acoustic speech to improve the overall recognition performance, particularly in noi…
Multimodal Continuous Turn-Taking Prediction Using Multiscale RNNs
Matthew Roddy, Gabriel Skantze, Naomi Harte
In human conversational interactions, turn-taking exchanges can be coordinated using cues from multiple modalities. To design spoken dialog systems that can conduct fluid interacti…
Investigating Speech Features for Continuous Turn-Taking Prediction Using LSTMs
Matthew Roddy, Gabriel Skantze, Naomi Harte
For spoken dialog systems to conduct fluid conversational interactions with users, the systems must be sensitive to turn-taking cues produced by a user. Models should be designed s…
Towards Lipreading Sentences with Active Appearance Models
George Sterpu, Naomi Harte
Automatic lipreading has major potential impact for speech recognition, supplementing and complementing the acoustic modality. Most attempts at lipreading have been performed on sm…
Can DNNs Learn to Lipread Full Sentences?
George Sterpu, Christian Saam, Naomi Harte
Finding visual features and suitable models for lipreading tasks that are more complex than a well-constrained vocabulary has proven challenging. This paper explores state-of-the-a…