13 citations · 67 across the 38 of their papers we have counts for
44 papers
MESSENGER: Memory-Enhanced Sequential Scene Flow Estimation via Autoregressive Next-Frame Forecasting
Jiuming Liu, Jianing Li, Mengmeng Liu +3
Scene flow can capture low-level 3D motion displacements in dynamic scenarios. Early pairwise estimators relying on instantaneous two-frame motion lack long-term temporal correlati…
Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update
Sitian Shen, Jiuming Liu, Mengmeng Liu +7
Recent video world models have witnessed the paradigm shift from single-agent to multi-agent involvements, which can reveal more complicated dynamics and cross-agent interaction in…
Can People Distinguish Human and AI Agency in Humanoid Teleoperation? A Preliminary Study of Agency Perception
Xiang Li, Koya Dendo, Keigo Minamida +3
Can people distinguish between human and AI agency in humanoid teleoperation? To explore this question, we developed \textit{Ghost-in-the-Loop}, a teleoperation framework that supp…
Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teaming
Jens Grubert, John Dudley, Eyal Ofek +1
Extended Reality (XR) is increasingly used in human-robot interaction to communicate robot intent, planned motion, reachability, and state. We argue that XR should also be understo…
A Taxonomy of Confabulations and the Perception-Reality Gap in LLM-Assisted Immersive Scene Editing
Junlong Chen, Per Ola Kristensson
Large language models (LLMs) are being increasingly integrated into immersive environments and design workflows, providing application prospects in areas such as rapid scene protot…
Beyond Conversations: Spatially-Anchored Previews for Intent Disambiguation in LLM-Assisted Geometry Editing in Virtual Reality
Junlong Chen, Amr Gomaa, Jens Grubert +1
User intent disambiguation remains a key challenge in intelligent interactive systems. While they have been widely studied in dialogue systems in 2D interfaces, research on how int…
Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
Jiuming Liu, Chaojun Ni, Mengmeng Liu +7
With rapid development of large language models and diffusion-based content generation, world modeling has attracted increasing research attention, benefiting various downstream do…
Grand Challenges around Designing Computers' Control Over Our Bodies
Florian 'Floyd' Mueller, Nadia Bianchi-Berthouze, Misha Sra +21
Advances in emerging technologies, such as on-body mechanical actuators and electrical muscle stimulation, have allowed computers to take control over our bodies. This presents opp…
How Do We Evaluate Experiences in Immersive Environments?
Xiang Li, Wei He, Per Ola Kristensson
How do we evaluate experiences in immersive environments? Despite decades of research in immersive technologies such as virtual reality, the field remains fragmented. Studies rely…
Cost-Aware Bayesian Optimization for Prototyping Interactive Devices
Thomas Langerak, Renate Zhang, Ziyuan Wang +2
Deciding which idea is worth prototyping is a central concern in iterative design. A prototype should be produced when the expected improvement is high and the cost is low. However…
MyoInteract: A Framework for Fast Prototyping of Biomechanical HCI Tasks using Reinforcement Learning
Ankit Bhattarai, Hannah Selder, Florian Fischer +2
Reinforcement learning (RL)-based biomechanical simulations have the potential to revolutionise HCI research and interaction design, but currently lack usability and interpretabili…
A Multi-Camera Optical Tag Neuronavigation and AR Augmentation Framework for Non-Invasive Brain Stimulation
Xuyi Hu, Ke Ma, Siwei Liu +2
Accurate neuronavigation is essential for generating the intended effect with transcranial magnetic stimulation (TMS). Precise coil placement also directly influences stimulation e…
Optical Tag-Based Neuronavigation and Augmentation System for Non-Invasive Brain Stimulation
Xuyi Hu, Ke Ma, Siwei Liu +2
Accurate neuronavigation is critical for effective transcranial magnetic stimulation (TMS), as stimulation outcomes depend directly on precise coil placement. Existing neuronavigat…
LocoScooter: Designing a Stationary Scooter-Based Locomotion System for Navigation in Virtual Reality
Wei He, Xiang Li, Per Ola Kristensson +1
Virtual locomotion remains a challenge in VR, especially in space-limited environments where room-scale walking is impractical. We present LocoScooter, a low-cost, deployable locom…
ImageTalk: Designing a Multimodal AAC Text Generation System Driven by Image Recognition and Natural Language Generation
Boyin Yang, Puming Jiang, Per Ola Kristensson
People living with Motor Neuron Disease (plwMND) frequently encounter speech and motor impairments that necessitate a reliance on augmentative and alternative communication (AAC) s…
The Argument is the Explanation: Structured Argumentation for Trust in Agents
Ege Cakar, Per Ola Kristensson
Humans are black boxes -- we cannot observe their neural processes, yet society functions by evaluating verifiable arguments. AI explainability should follow this principle: stakeh…
Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
Zihan Ding, Xinyi Wang, Junlong Chen +2
Creators struggle to edit long-form, narrative-rich videos not because of UI complexity, but due to the cognitive demands of searching, storyboarding, and sequencing hours of foota…
Unbounded: Object-Boundary Interaction in Mixed Reality
Zhuoyue Lyu, Per Ola Kristensson
Boundaries such as walls, windows, and doors are ubiquitous in the physical world, yet their potential in mixed reality (MR) remains underexplored. We present Unbounded, a Research…
Demystifying Reward Design in Reinforcement Learning for Upper Extremity Interaction: Practical Guidelines for Biomechanical Simulations in HCI
Hannah Selder, Florian Fischer, Per Ola Kristensson +1
Designing effective reward functions is critical for reinforcement learning-based biomechanical simulations, yet HCI researchers and practitioners often waste (computation) time wi…
Mind & Motion: Opportunities and Applications of Integrating Biomechanics and Cognitive Models in HCI
Arthur Fleig, Florian Fischer, Markus Klar +5
Computational models of how users perceive and act within a virtual or physical environment offer enormous potential for the understanding and design of user interactions. Cognitio…
Bend It, Aim It, Tap It: Designing an On-Body Disambiguation Mechanism for Curve Selection in Mixed Reality
Xiang Li, Per Ola Kristensson
Object selection in Mixed Reality (MR) becomes particularly challenging in dense or occluded environments, where traditional mid-air ray-casting often leads to ambiguity and reduce…
ReachVox: Clutter-free Reachability Visualization for Robot Motion Planning in Virtual Reality
Steffen Hauck, Diar Abdlkarim, John Dudley +3
Human-Robot-Collaboration can enhance workflows by leveraging the mutual strengths of human operators and robots. Planning and understanding robot movements remain major challenges…
Handows: A Palm-Based Interactive Multi-Window Management System in Virtual Reality
Jindu Wang, Ke Zhou, Haoyu Ren +2
Window management in virtual reality (VR) remains a challenging task due to the spatial complexity and physical demands of current interaction methods. We introduce Handows, a palm…
Evaluating the Usability of Microgestures for Text Editing Tasks in Virtual Reality
Xiang Li, Wei He, Per Ola Kristensson
As virtual reality (VR) continues to evolve, traditional input methods such as handheld controllers and gesture systems often face challenges with precision, social accessibility,…