9 citations · 19 across the 10 of their papers we have counts for
14 papers
Semi-supervised Interactive Intent Labeling
Saurav Sahay, Eda Okur, Nagib Hakim +1
Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant…
Audio-Visual Understanding of Passenger Intents for In-Cabin Conversational Agents
Eda Okur, Shachi H Kumar, Saurav Sahay +1
Building multimodal dialogue understanding capabilities situated in the in-cabin context is crucial to enhance passenger comfort in autonomous vehicle (AV) interaction systems. To…
Low Rank Fusion based Transformers for Multimodal Sequences
Saurav Sahay, Eda Okur, Shachi H Kumar +1
Our senses individually work in a coordinated fashion to express our emotional intentions. In this work, we experiment with modeling modality-specific sensory signals to attend to…
Exploring Context, Attention and Audio Features for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
We are witnessing a confluence of vision, speech and dialog system technologies that are enabling the IVAs to learn audio-visual groundings of utterances and have conversations wit…
Leveraging Topics and Audio Features with Multimodal Attention for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
With the recent advancements in Artificial Intelligence (AI), Intelligent Virtual Assistants (IVA) such as Alexa, Google Home, etc., have become a ubiquitous part of many homes. Cu…
Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions
Saurav Sahay, Shachi H Kumar, Eda Okur +2
Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recog…