9 citations · 30 across the 17 of their papers we have counts for
20 papers
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models
Shachi H Kumar, Saurav Sahay, Sahisnu Mazumder +6
Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are sus…
Inspecting Spoken Language Understanding from Kids for Basic Math Learning at Home
Eda Okur, Roddy Fuentes Alba, Saurav Sahay +1
Enriching the quality of early childhood education with interactive math learning at home systems, empowered by recent advances in conversational AI technologies, is slowly becomin…
Position Matters! Empirical Study of Order Effect in Knowledge-grounded Dialogue
Hsuan Su, Shachi H Kumar, Sahisnu Mazumder +7
With the power of large pretrained language models, various research works have integrated knowledge into dialogue systems. The traditional techniques treat knowledge as part of th…
End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics
Eda Okur, Saurav Sahay, Roddy Fuentes Alba +1
The advances in language-based Artificial Intelligence (AI) technologies applied to build educational applications can present AI for social-good opportunities with a broader posit…
NLU for Game-based Learning in Real: Initial Evaluations
Eda Okur, Saurav Sahay, Lama Nachman
Intelligent systems designed for play-based interactions should be contextually aware of the users and their surroundings. Spoken Dialogue Systems (SDS) are critical for these inte…
Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System
Eda Okur, Saurav Sahay, Lama Nachman
Contextually aware intelligent agents are often required to understand the users and their surroundings in real-time. Our goal is to build Artificial Intelligence (AI) systems that…
Semi-supervised Interactive Intent Labeling
Saurav Sahay, Eda Okur, Nagib Hakim +1
Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant…
Audio-Visual Understanding of Passenger Intents for In-Cabin Conversational Agents
Eda Okur, Shachi H Kumar, Saurav Sahay +1
Building multimodal dialogue understanding capabilities situated in the in-cabin context is crucial to enhance passenger comfort in autonomous vehicle (AV) interaction systems. To…
Low Rank Fusion based Transformers for Multimodal Sequences
Saurav Sahay, Eda Okur, Shachi H Kumar +1
Our senses individually work in a coordinated fashion to express our emotional intentions. In this work, we experiment with modeling modality-specific sensory signals to attend to…
Exploring Context, Attention and Audio Features for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
We are witnessing a confluence of vision, speech and dialog system technologies that are enabling the IVAs to learn audio-visual groundings of utterances and have conversations wit…
Leveraging Topics and Audio Features with Multimodal Attention for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +2
With the recent advancements in Artificial Intelligence (AI), Intelligent Virtual Assistants (IVA) such as Alexa, Google Home, etc., have become a ubiquitous part of many homes. Cu…
Modeling Intent, Dialog Policies and Response Adaptation for Goal-Oriented Interactions
Saurav Sahay, Shachi H Kumar, Eda Okur +2
Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recog…
Towards Multimodal Understanding of Passenger-Vehicle Interactions in Autonomous Vehicles: Intent/Slot Recognition Utilizing Audio-Visual Data
Eda Okur, Shachi H Kumar, Saurav Sahay +1
Understanding passenger intents from spoken interactions and car's vision (both inside and outside the vehicle) are important building blocks towards developing contextual dialog s…
Natural Language Interactions in Autonomous Vehicles: Intent Detection and Slot Filling from Passenger Utterances
Eda Okur, Shachi H Kumar, Saurav Sahay +2
Understanding passenger intents and extracting relevant slots are important building blocks towards developing contextual dialogue systems for natural interactions in autonomous ve…
Unobtrusive and Multimodal Approach for Behavioral Engagement Detection of Students
Nese Alyuz, Eda Okur, Utku Genc +3
We propose a multimodal approach for detection of students' behavioral engagement states (i.e., On-Task vs. Off-Task), based on three unobtrusive modalities: Appearance, Context-Pe…
Detecting Behavioral Engagement of Students in the Wild Based on Contextual and Visual Data
Eda Okur, Nese Alyuz, Sinem Aslan +3
To investigate the detection of students' behavioral engagement (On-Task vs. Off-Task), we propose a two-phase approach in this study. In Phase 1, contextual logs (URLs) are utiliz…
The Importance of Socio-Cultural Differences for Annotating and Detecting the Affective States of Students
Eda Okur, Sinem Aslan, Nese Alyuz +2
The development of real-time affect detection models often depends upon obtaining annotated data for supervised learning by employing human experts to label the student data. One o…
Context, Attention and Audio Feature Explorations for Audio Visual Scene-Aware Dialog
Shachi H Kumar, Eda Okur, Saurav Sahay +3
With the recent advancements in AI, Intelligent Virtual Assistants (IVA) have become a ubiquitous part of every home. Going forward, we are witnessing a confluence of vision, speec…
Conversational Intent Understanding for Passengers in Autonomous Vehicles
Eda Okur, Shachi H Kumar, Saurav Sahay +2
Understanding passenger intents and extracting relevant slots are important building blocks towards developing a contextual dialogue system responsible for handling certain vehicle…
Named Entity Recognition on Twitter for Turkish using Semi-supervised Learning with Word Embeddings
Eda Okur, Hakan Demir, Arzucan Özgür
Recently, due to the increasing popularity of social media, the necessity for extracting information from informal text types, such as microblog texts, has gained significant atten…