13 citations · 67 across the 38 of their papers we have counts for
33 papers · 1 filter
Can People Distinguish Human and AI Agency in Humanoid Teleoperation? A Preliminary Study of Agency Perception
Xiang Li, Koya Dendo, Keigo Minamida +3
Can people distinguish between human and AI agency in humanoid teleoperation? To explore this question, we developed \textit{Ghost-in-the-Loop}, a teleoperation framework that supp…
Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming
Jens Grubert, John Dudley, Eyal Ofek +1
Extended Reality (XR) is increasingly used in human-robot interaction to communicate robot intent, planned motion, reachability, and state. We argue that XR should also be understo…
A Taxonomy of Confabulations and the Perception-Reality Gap in LLM-Assisted Immersive Scene Editing
Junlong Chen, Per Ola Kristensson
Large language models (LLMs) are being increasingly integrated into immersive environments and design workflows, providing application prospects in areas such as rapid scene protot…
Beyond Conversations: Spatially-Anchored Previews for Intent Disambiguation in LLM-Assisted Geometry Editing in Virtual Reality
Junlong Chen, Amr Gomaa, Jens Grubert +1
User intent disambiguation remains a key challenge in intelligent interactive systems. While they have been widely studied in dialogue systems in 2D interfaces, research on how int…
Grand Challenges around Designing Computers' Control Over Our Bodies
Florian 'Floyd' Mueller, Nadia Bianchi-Berthouze, Misha Sra +21
Advances in emerging technologies, such as on-body mechanical actuators and electrical muscle stimulation, have allowed computers to take control over our bodies. This presents opp…
How Do We Evaluate Experiences in Immersive Environments?
Xiang Li, Wei He, Per Ola Kristensson
How do we evaluate experiences in immersive environments? Despite decades of research in immersive technologies such as virtual reality, the field remains fragmented. Studies rely…
Cost-Aware Bayesian Optimization for Prototyping Interactive Devices
Thomas Langerak, Renate Zhang, Ziyuan Wang +2
Deciding which idea is worth prototyping is a central concern in iterative design. A prototype should be produced when the expected improvement is high and the cost is low. However…
MyoInteract: A Framework for Fast Prototyping of Biomechanical HCI Tasks using Reinforcement Learning
Ankit Bhattarai, Hannah Selder, Florian Fischer +2
Reinforcement learning (RL)-based biomechanical simulations have the potential to revolutionise HCI research and interaction design, but currently lack usability and interpretabili…
A Multi-Camera Optical Tag Neuronavigation and AR Augmentation Framework for Non-Invasive Brain Stimulation
Xuyi Hu, Ke Ma, Siwei Liu +2
Accurate neuronavigation is essential for generating the intended effect with transcranial magnetic stimulation (TMS). Precise coil placement also directly influences stimulation e…
Optical Tag-Based Neuronavigation and Augmentation System for Non-Invasive Brain Stimulation
Xuyi Hu, Ke Ma, Siwei Liu +2
Accurate neuronavigation is critical for effective transcranial magnetic stimulation (TMS), as stimulation outcomes depend directly on precise coil placement. Existing neuronavigat…
LocoScooter: Designing a Stationary Scooter-Based Locomotion System for Navigation in Virtual Reality
Wei He, Xiang Li, Per Ola Kristensson +1
Virtual locomotion remains a challenge in VR, especially in space-limited environments where room-scale walking is impractical. We present LocoScooter, a low-cost, deployable locom…
ImageTalk: Designing a Multimodal AAC Text Generation System Driven by Image Recognition and Natural Language Generation
Boyin Yang, Puming Jiang, Per Ola Kristensson
People living with Motor Neuron Disease (plwMND) frequently encounter speech and motor impairments that necessitate a reliance on augmentative and alternative communication (AAC) s…
Unbounded: Object-Boundary Interaction in Mixed Reality
Zhuoyue Lyu, Per Ola Kristensson
Boundaries such as walls, windows, and doors are ubiquitous in the physical world, yet their potential in mixed reality (MR) remains underexplored. We present Unbounded, a Research…
Demystifying Reward Design in Reinforcement Learning for Upper Extremity Interaction: Practical Guidelines for Biomechanical Simulations in HCI
Hannah Selder, Florian Fischer, Per Ola Kristensson +1
Designing effective reward functions is critical for reinforcement learning-based biomechanical simulations, yet HCI researchers and practitioners often waste (computation) time wi…
Mind & Motion: Opportunities and Applications of Integrating Biomechanics and Cognitive Models in HCI
Arthur Fleig, Florian Fischer, Markus Klar +5
Computational models of how users perceive and act within a virtual or physical environment offer enormous potential for the understanding and design of user interactions. Cognitio…
Bend It, Aim It, Tap It: Designing an On-Body Disambiguation Mechanism for Curve Selection in Mixed Reality
Xiang Li, Per Ola Kristensson
Object selection in Mixed Reality (MR) becomes particularly challenging in dense or occluded environments, where traditional mid-air ray-casting often leads to ambiguity and reduce…
ReachVox: Clutter-free Reachability Visualization for Robot Motion Planning in Virtual Reality
Steffen Hauck, Diar Abdlkarim, John Dudley +3
Human-Robot-Collaboration can enhance workflows by leveraging the mutual strengths of human operators and robots. Planning and understanding robot movements remain major challenges…
Handows: A Palm-Based Interactive Multi-Window Management System in Virtual Reality
Jindu Wang, Ke Zhou, Haoyu Ren +2
Window management in virtual reality (VR) remains a challenging task due to the spatial complexity and physical demands of current interaction methods. We introduce Handows, a palm…
Evaluating the Usability of Microgestures for Text Editing Tasks in Virtual Reality
Xiang Li, Wei He, Per Ola Kristensson
As virtual reality (VR) continues to evolve, traditional input methods such as handheld controllers and gesture systems often face challenges with precision, social accessibility,…
What Makes a Model Breathe? Understanding Reinforcement Learning Reward Function Design in Biomechanical User Simulation
Hannah Selder, Florian Fischer, Per Ola Kristensson +1
Biomechanical models allow for diverse simulations of user movements in interaction. Their performance depends critically on the careful design of reward functions, yet the interpl…
Optimizing Curve-Based Selection with On-Body Surfaces in Virtual Environments
Xiang Li, Per Ola Kristensson
Virtual Reality (VR) interfaces often rely on linear ray-casting for object selection but struggle with precision in dense or occluded environments. This late-breaking work introdu…
AlphaPIG: The Nicest Way to Prolong Interactive Gestures in Extended Reality
Yi Li, Florian Fischer, Tim Dwyer +4
Mid-air gestures serve as a common interaction modality across Extended Reality (XR) applications, enhancing engagement and ownership through intuitive body movements. However, pro…
Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction
Zhuoyue Lyu, Per Ola Kristensson
Everyday object-based interactions (EOIs) and mid-air gesture interactions (MAIs) have been widely explored, yet prior work on their integration often targets narrow use cases or s…
EnVisionVR: A Scene Interpretation Tool for Visual Accessibility in Virtual Reality
Junlong Chen, Rosella P. Galindo Esparza, Vanja Garaj +2
Effective visual accessibility in Virtual Reality (VR) is crucial for Blind and Low Vision (BLV) users. However, designing visual accessibility systems is challenging due to the co…