63 citations · 107 across the 20 of their papers we have counts for
22 papers
FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices
Chenfeng Gao, Taeyoung Yeon, Sungheon Park +4
Prior avatar embodiment research has studied tracking completeness (how faithfully the body, hands, and face are sensed and reproduced) and personalized appearance in isolation, ea…
Generative Proxy: Synthesizing Proxy-Based Interfaces for Real-World Interaction Across AR Glasses
Xianhao Carton Liu, William Chastek, Eric J Gonzalez +2
Interacting with real-world objects in AR is difficult, especially when targets are distant, cluttered, or occluded. These challenges are amplified on emerging lightweight AR glass…
VisionClaw: Always-On AI Agents through Smart Glasses
Xiaoan Liu, DaeHo Lee, Eric J Gonzalez +2
We present VisionClaw, an always-on wearable AI agent that integrates live egocentric perception with agentic task execution. Running on Meta Ray-Ban smart glasses, VisionClaw cont…
Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
Mathias N. Lystbæk, Haley Adams, Ranjith Kagathi Ananda +6
Audio-only walking navigation can leave users disoriented, relying on vague cardinal directions and lacking real-time environmental context, leading to frequent errors. To address…
Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
Xiaoan Liu, Eric J Gonzalez, Nels Numan +5
Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for plannin…
Sticky and Magnetic: Evaluating Error Correction and User Adaptation in Gaze and Pinch Interaction
Jazmin Collins, Prasanthi Gurumurthy, Eric J. Gonzalez +1
The gaze-and-pinch framework offers a high-fidelity interaction modality for spatial computing in virtual reality (VR), yet it remains vulnerable to coordination errors--timing mis…
SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions
Vasco Xu, Brian Chen, Eric J. Gonzalez +4
Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods…
World Mouse: Exploring Interactions with a Cross-Reality Cursor
Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel +1
As Extended Reality (XR) systems increasingly map and understand the physical world, interacting with these blended representations remains challenging. The current push for "natur…
VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
Zhaochong An, Orest Kupyn, Théo Uscidda +5
Large-scale video diffusion models achieve impressive visual quality, yet often fail to preserve geometric consistency. Prior approaches improve consistency either by augmenting th…
Revisiting put-that-there, context aware window interactions via LLMs
Riccardo Bovo, Daniele Giunchi, Pasquale Cascarano +2
We revisit Bolt's classic "Put-That-There" concept for modern head-mounted displays by pairing Large Language Models (LLMs) with XR sensor and tech stack. The agent fuses (i) a sem…
HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand Tracking
Esen K. Tütüncü, Mar Gonzalez-Franco, Eric J. Gonzalez
We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-…
ForcePinch: Force-Responsive Spatial Interaction for Tracking Speed Control in XR
Chenyang Zhang, Tiffany S Ma, John Andrews +3
Spatial interaction in 3D environments requires balancing efficiency and precision, which requires dynamic tracking speed adjustments. However, existing techniques often couple tra…
Reality Proxy: Fluid Interactions with Real-World Objects in MR via Abstract Representations
Xiaoan Liu, Difan Jia, Xianhao Carton Liu +2
Interacting with real-world objects in Mixed Reality (MR) often proves difficult when they are crowded, distant, or partially occluded, hindering straightforward selection and mani…
Symbiotic AI: Augmenting Human Cognition from PCs to Cars
Riccardo Bovo, Karan Ahuja, Ryo Suzuki +2
As AI takes on increasingly complex roles in human-computer interaction, fundamental questions arise: how can HCI help maintain the user as the primary agent while augment human co…
Text Entry for XR Trove (TEXT): Collecting and Analyzing Techniques for Text Input in XR
Arpit Bhatia, Moaaz Hudhud Mughrabi, Diar Abdlkarim +4
Text entry for extended reality (XR) is far from perfect, and a variety of text entry techniques (TETs) have been proposed to fit various contexts of use. However, comparing betwee…
PinchCatcher: Enabling Multi-selection for Gaze+Pinch
Jinwook Kim, Sangmin Park, Qiushi Zhou +3
This paper investigates multi-selection in XR interfaces based on eye and hand interaction. We propose enabling multi-selection using different variations of techniques that combin…
Everyday AR through AI-in-the-Loop
Ryo Suzuki, Mar Gonzalez-Franco, Misha Sra +1
This workshop brings together experts and practitioners from augmented reality (AR) and artificial intelligence (AI) to shape the future of AI-in-the-loop everyday AR experiences.…
EmBARDiment: an Embodied AI Agent for Productivity in XR
Riccardo Bovo, Steven Abreu, Karan Ahuja +3
XR devices running chat-bots powered by Large Language Models (LLMs) have the to become always-on agents that enable much better productivity scenarios. Current screen based chat-b…
Geometry Fidelity for Spherical Images
Anders Christensen, Nooshin Mojab, Khushman Patel +5
Spherical or omni-directional images offer an immersive visual format appealing to a wide range of computer vision applications. However, geometric properties of spherical images p…
PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videos
Steven Abreu, Tiffany D. Do, Karan Ahuja +4
Intelligent assistance involves not only understanding but also action. Existing ego-centric video datasets contain rich annotations of the videos, but not of actions that an intel…
Hovering Over the Key to Text Input in XR
Mar Gonzalez-Franco, Diar Abdlkarim, Arpit Bhatia +6
Virtual, Mixed, and Augmented Reality (XR) technologies hold immense potential for transforming productivity beyond PC. Therefore there is a critical need for improved text input s…
Augmented Object Intelligence with XR-Objects
Mustafa Doga Dogan, Eric J. Gonzalez, Karan Ahuja +5
Seamless integration of physical objects as interactive digital entities remains a challenge for spatial computing. This paper explores Augmented Object Intelligence (AOI) in the c…