6 papers · 1 filter
A Taxonomy of Confabulations and the Perception-Reality Gap in LLM-Assisted Immersive Scene Editing
Junlong Chen, Per Ola Kristensson
Large language models (LLMs) are being increasingly integrated into immersive environments and design workflows, providing application prospects in areas such as rapid scene protot…
Beyond Conversations: Spatially-Anchored Previews for Intent Disambiguation in LLM-Assisted Geometry Editing in Virtual Reality
Junlong Chen, Amr Gomaa, Jens Grubert +1
User intent disambiguation remains a key challenge in intelligent interactive systems. While they have been widely studied in dialogue systems in 2D interfaces, research on how int…
Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes
Junlong Chen, Jens Grubert, Per Ola Kristensson
As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and po…
EnVisionVR: A Scene Interpretation Tool for Visual Accessibility in Virtual Reality
Junlong Chen, Rosella P. Galindo Esparza, Vanja Garaj +2
Effective visual accessibility in Virtual Reality (VR) is crucial for Blind and Low Vision (BLV) users. However, designing visual accessibility systems is challenging due to the co…
Generative AI for Accessible and Inclusive Extended Reality
Jens Grubert, Junlong Chen, Per Ola Kristensson
Artificial Intelligence-Generated Content (AIGC) has the potential to transform how people build and interact with virtual environments. Within this paper, we discuss potential ben…
Large Language Model-assisted Speech and Pointing Benefits Multiple 3D Object Selection in Virtual Reality
Junlong Chen, Jens Grubert, Per Ola Kristensson
Selection of occluded objects is a challenging problem in virtual reality, even more so if multiple objects are involved. With the advent of new artificial intelligence technologie…