18 papers
Generative Proxy: Synthesizing Proxy-Based Interfaces for Real-World Interaction Across AR Glasses
Xianhao Carton Liu, William Chastek, Eric J Gonzalez +2
Interacting with real-world objects in AR is difficult, especially when targets are distant, cluttered, or occluded. These challenges are amplified on emerging lightweight AR glass…
VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
Zhaochong An, Orest Kupyn, Théo Uscidda +5
Large-scale video diffusion models achieve impressive visual quality, yet often fail to preserve geometric consistency. Prior approaches improve consistency either by augmenting th…
VisionClaw: Always-On AI Agents through Smart Glasses
Xiaoan Liu, DaeHo Lee, Eric J Gonzalez +2
We present VisionClaw, an always-on wearable AI agent that integrates live egocentric perception with agentic task execution. Running on Meta Ray-Ban smart glasses, VisionClaw cont…
Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
Mathias N. Lystbæk, Haley Adams, Ranjith Kagathi Ananda +6
Audio-only walking navigation can leave users disoriented, relying on vague cardinal directions and lacking real-time environmental context, leading to frequent errors. To address…
Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
Xiaoan Liu, Eric J Gonzalez, Nels Numan +5
Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for plannin…
Sticky and Magnetic: Evaluating Error Correction and User Adaptation in Gaze and Pinch Interaction
Jazmin Collins, Prasanthi Gurumurthy, Eric J. Gonzalez +1
The gaze-and-pinch framework offers a high-fidelity interaction modality for spatial computing in virtual reality (VR), yet it remains vulnerable to coordination errors--timing mis…