5 papers
DuoZone: A User-Centric, LLM-Guided Mixed-Initiative XR Window Management System
Jing Qian, George X. Wang, Xiangyu Li +5
Mixed reality (XR) environments offer vast spatial possibilities, but current window management systems require users to manually place, resize, and organize multiple applications…
Cam-2-Cam: Exploring the Design Space of Dual-Camera Interactions for Smartphone-based Augmented Reality
Brandon Woodard, Melvin He, Mose Sakashita +3
Off-the-shelf smartphone-based AR systems typically use a single front-facing or rear-facing camera, which restricts user interactions to a narrow field of view and small screen si…
Design and Implementation of the Transparent, Interpretable, and Multimodal (TIM) AR Personal Assistant
Erin McGowan, Joao Rulff, Sonia Castelo +11
The concept of an AI assistant for task guidance is rapidly shifting from a science fiction staple to an impending reality. Such a system is inherently complex, requiring models fo…
Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modeling
Chenyi Li, Guande Wu, Gromit Yeuk-Yin Chan +6
Augmented Reality (AR) assistance is increasingly used for supporting users with physical tasks like assembly and cooking. However, most systems rely on reactive responses triggere…
AdaptiveCoPilot: Design and Testing of a NeuroAdaptive LLM Cockpit Guidance System in both Novice and Expert Pilots
Shaoyue Wen, Michael Middleton, Songming Ping +12
Pilots operating modern cockpits often face high cognitive demands due to complex interfaces and multitasking requirements, which can lead to overload and decreased performance. Th…