63 citations · 70 across the 17 of their papers we have counts for
17 papers
GazeTune: Facilitating Precise Gaze-Driven Interactions with Cascaded Touch Input
Jina Kim, Eric J. Gonzalez, Yang Zhang +1
Eye gaze has become an essential input for spatial computing, but its coarse targeting and saccadic nature limit precision and complicate continuous interactions such as dragging,…
Generative Proxy: Synthesizing Proxy-Based Interfaces for Real-World Interaction Across AR Glasses
Xianhao Carton Liu, William Chastek, Eric J Gonzalez +2
Interacting with real-world objects in AR is difficult, especially when targets are distant, cluttered, or occluded. These challenges are amplified on emerging lightweight AR glass…
VisionClaw: Always-On AI Agents through Smart Glasses
Xiaoan Liu, DaeHo Lee, Eric J Gonzalez +2
We present VisionClaw, an always-on wearable AI agent that integrates live egocentric perception with agentic task execution. Running on Meta Ray-Ban smart glasses, VisionClaw cont…
Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
Mathias N. Lystbæk, Haley Adams, Ranjith Kagathi Ananda +6
Audio-only walking navigation can leave users disoriented, relying on vague cardinal directions and lacking real-time environmental context, leading to frequent errors. To address…
Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
Xiaoan Liu, Eric J Gonzalez, Nels Numan +5
Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for plannin…
Sticky and Magnetic: Evaluating Error Correction and User Adaptation in Gaze and Pinch Interaction
Jazmin Collins, Prasanthi Gurumurthy, Eric J. Gonzalez +1
The gaze-and-pinch framework offers a high-fidelity interaction modality for spatial computing in virtual reality (VR), yet it remains vulnerable to coordination errors--timing mis…
SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions
Vasco Xu, Brian Chen, Eric J. Gonzalez +4
Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods…
World Mouse: Exploring Interactions with a Cross-Reality Cursor
Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel +1
As Extended Reality (XR) systems increasingly map and understand the physical world, interacting with these blended representations remains challenging. The current push for "natur…
Break the Window: Exploring Spatial Decomposition of Webpages in XR
Chenyang Zhang, Tianjian Wei, Haoyang Yang +3
Most XR web browsers still present webpages as a single floating window, carrying over desktop design assumptions into immersive space. We explore an alternative by breaking the br…
DeltaDorsal: Enhancing Hand Pose Estimation with Dorsal Features in Egocentric Views
William Huang, Siyou Pei, Leyi Zou +3
The proliferation of XR devices has made egocentric hand pose estimation a vital task, yet this perspective is inherently challenged by frequent finger occlusions. To address this,…
Revisiting put-that-there, context aware window interactions via LLMs
Riccardo Bovo, Daniele Giunchi, Pasquale Cascarano +2
We revisit Bolt's classic "Put-That-There" concept for modern head-mounted displays by pairing Large Language Models (LLMs) with XR sensor and tech stack. The agent fuses (i) a sem…
HandOver: Enabling Precise Selection & Manipulation of 3D Objects with Mouse and Hand Tracking
Esen K. Tütüncü, Mar Gonzalez-Franco, Eric J. Gonzalez
We present HandOver, an extended reality (XR) interaction technique designed to unify the precision of traditional mouse input for object selection with the expressiveness of hand-…
ForcePinch: Force-Responsive Spatial Interaction for Tracking Speed Control in XR
Chenyang Zhang, Tiffany S Ma, John Andrews +3
Spatial interaction in 3D environments requires balancing efficiency and precision, which requires dynamic tracking speed adjustments. However, existing techniques often couple tra…
EmBARDiment: an Embodied AI Agent for Productivity in XR
Riccardo Bovo, Steven Abreu, Karan Ahuja +3
XR devices running chat-bots powered by Large Language Models (LLMs) have the to become always-on agents that enable much better productivity scenarios. Current screen based chat-b…
PARSE-Ego4D: Personal Action Recommendation Suggestions for Egocentric Videos
Steven Abreu, Tiffany D. Do, Karan Ahuja +4
Intelligent assistance involves not only understanding but also action. Existing ego-centric video datasets contain rich annotations of the videos, but not of actions that an intel…
Hovering Over the Key to Text Input in XR
Mar Gonzalez-Franco, Diar Abdlkarim, Arpit Bhatia +6
Virtual, Mixed, and Augmented Reality (XR) technologies hold immense potential for transforming productivity beyond PC. Therefore there is a critical need for improved text input s…
Augmented Object Intelligence with XR-Objects
Mustafa Doga Dogan, Eric J. Gonzalez, Karan Ahuja +5
Seamless integration of physical objects as interactive digital entities remains a challenge for spatial computing. This paper explores Augmented Object Intelligence (AOI) in the c…