9 citations · 19 across the 7 of their papers we have counts for
10 papers
Audio-Visual Understanding of Passenger Intents for In-Cabin Conversational Agents
Eda Okur, Shachi H Kumar, Saurav Sahay +1
Building multimodal dialogue understanding capabilities situated in the in-cabin context is crucial to enhance passenger comfort in autonomous vehicle (AV) interaction systems. To…
Low Rank Fusion based Transformers for Multimodal Sequences
Saurav Sahay, Eda Okur, Shachi H Kumar +1
Our senses individually work in a coordinated fashion to express our emotional intentions. In this work, we experiment with modeling modality-specific sensory signals to attend to…
Exploring Context, Attention and Audio Features for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
We are witnessing a confluence of vision, speech and dialog system technologies that are enabling the IVAs to learn audio-visual groundings of utterances and have conversations wit…
Leveraging Topics and Audio Features with Multimodal Attention for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
With the recent advancements in Artificial Intelligence (AI), Intelligent Virtual Assistants (IVA) such as Alexa, Google Home, etc., have become a ubiquitous part of many homes. Cu…
Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions
Saurav Sahay, Shachi H Kumar, Eda Okur +2
Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recog…
Towards Multimodal Understanding of Passenger-Vehicle Interactions in Autonomous Vehicles: Intent/Slot Recognition Utilizing Audio-Visual Data
Eda Okur, Shachi H Kumar, Saurav Sahay +1
Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog s…