11 papers
Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming
Jens Grubert, John Dudley, Eyal Ofek +1
Extended Reality (XR) is increasingly used in human-robot interaction to communicate robot intent, planned motion, reachability, and state. We argue that XR should also be understo…
Beyond Conversations: Spatially-Anchored Previews for Intent Disambiguation in LLM-Assisted Geometry Editing in Virtual Reality
Junlong Chen, Amr Gomaa, Jens Grubert +1
User intent disambiguation remains a key challenge in intelligent interactive systems. While they have been widely studied in dialogue systems in 2D interfaces, research on how int…
An AI-Driven Virtual Patient for Breaking Bad News: An Expert Formative Study on Facial Expression Intensity
Steffen Hauck, Theresa Schell, Sophie Jörg +1
Interactive virtual patients driven by large language models (LLMs) offer scalable solutions for medical communication training, such as breaking bad news. However, designing their…
Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes
Junlong Chen, Jens Grubert, Per Ola Kristensson
As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and po…
Behavioral and Symbolic Fillers as Delay Mitigation for Embodied Conversational Agents in Virtual Reality
Denmar Mojan Gonzales, Snehanjali Kalamkar, Sophie Jörg +1
When communicating with embodied conversational agents (ECAs) in virtual reality, there might be delays in the responses of the agents lasting several seconds, for example, due to…
ReachVox: Clutter-free Reachability Visualization for Robot Motion Planning in Virtual Reality
Steffen Hauck, Diar Abdlkarim, John Dudley +3
Human-Robot-Collaboration can enhance workflows by leveraging the mutual strengths of human operators and robots. Planning and understanding robot movements remain major challenges…