5 papers
From Gaze to Guidance: Interpreting and Adapting to Users' Cognitive Needs with Multimodal Gaze-Aware AI Assistants
Valdemar Danry, Javier Hernandez, Andrew Wilson +2
Current LLM assistants are powerful at answering questions, but they have limited access to the behavioral context that reveals when and where a user is struggling. We present a ga…
RESPOND: Responsive Engagement Strategy for Predictive Orchestration and Dialogue
Meng-Chen Lee, Costas Panay, Javier Hernandez +4
The majority of voice-based conversational agents still rely on pause-and-respond turn-taking, leaving interactions sounding stiff and robotic. We present RESPOND (Responsive Engag…
Storycaster: An AI System for Immersive Room-Based Storytelling
Naisha Agarwal, Judith Amores, Andrew D. Wilson
While Cave Automatic Virtual Environment (CAVE) systems have long enabled room-scale virtual reality and various kinds of interactivity, their content has largely remained predeter…
From Measurement to Expertise: Empathetic Expert Adapters for Context-Based Empathy in Conversational AI Agents
Erfan Shayegani, Jina Suh, Andy Wilson +2
Empathy is a critical factor in fostering positive user experiences in conversational AI. While models can display empathy, it is often generic rather than tailored to specific tas…
Understanding Communication Preferences of Information Workers in Engagement with Text-Based Conversational Agents
Ananya Bhattacharjee, Jina Suh, Mahsa Ershadi +3
Communication traits in text-based human-AI conversations play pivotal roles in shaping user experiences and perceptions of systems. With the advancement of large language models (…