Mitigating Response Delays in Free-Form Conversations with LLM-powered Intelligent Virtual Agents
arXiv:2507.22352 · doi:10.1145/3719160.3736636
Abstract
We investigated the challenges of mitigating response delays in free-form conversations with virtual agents powered by Large Language Models (LLMs) within Virtual Reality (VR). For this, we used conversational fillers, such as gestures and verbal cues, to bridge delays between user input and system responses and evaluate their effectiveness across various latency levels and interaction scenarios. We found that latency above 4 seconds degrades quality of experience, while natural conversational fillers improve perceived response time, especially in high-delay conditions. Our findings provide insights for practitioners and researchers to optimize user engagement whenever conversational systems' responses are delayed by network limitations or slow hardware. We also contribute an open-source pipeline that streamlines deploying conversational agents in virtual environments.
15 pages, 8 figures. Published at the 7th ACM Conference on Conversational User Interfaces (CUI '25), July 8-10, 2025, Waterloo, Canada. Open-source code available at https://github.com/ISUE/iva-cui
References in corpus (5)
- A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons
- VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language Models
- Virtual Agents for Alcohol Use Counseling: Exploring LLM-Powered Motivational Interviewing
- VALID: A perceptually validated Virtual Avatar Library for Inclusion and Diversity
- SAPIEN: Affective Virtual Agents Powered by Large Language Models