13 papers
Generative Proxy: Synthesizing Proxy-Based Interfaces for Real-World Interaction Across AR Glasses
Xianhao Carton Liu, William Chastek, Eric J Gonzalez +2
Interacting with real-world objects in AR is difficult, especially when targets are distant, cluttered, or occluded. These challenges are amplified on emerging lightweight AR glass…
VisionClaw: Always-On AI Agents through Smart Glasses
Xiaoan Liu, DaeHo Lee, Eric J Gonzalez +2
We present VisionClaw, an always-on wearable AI agent that integrates live egocentric perception with agentic task execution. Running on Meta Ray-Ban smart glasses, VisionClaw cont…
Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
Mathias N. Lystbæk, Haley Adams, Ranjith Kagathi Ananda +6
Audio-only walking navigation can leave users disoriented, relying on vague cardinal directions and lacking real-time environmental context, leading to frequent errors. To address…
Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
Xiaoan Liu, Eric J Gonzalez, Nels Numan +5
Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for plannin…
Sticky and Magnetic: Evaluating Error Correction and User Adaptation in Gaze and Pinch Interaction
Jazmin Collins, Prasanthi Gurumurthy, Eric J. Gonzalez +1
The gaze-and-pinch framework offers a high-fidelity interaction modality for spatial computing in virtual reality (VR), yet it remains vulnerable to coordination errors--timing mis…
SurfaceXR: Fusing Smartwatch IMUs and Egocentric Hand Pose for Seamless Surface Interactions
Vasco Xu, Brian Chen, Eric J. Gonzalez +4
Mid-air gestures in Extended Reality (XR) often cause fatigue and imprecision. Surface-based interactions offer improved accuracy and comfort, but current egocentric vision methods…