6 papers
You Cannot Optimize What You Cannot Measure: Multitasking Evaluation as the Missing Foundation of AI-Mediated Heads-Up Interaction
Nuwan Janaka, Runze Cai, Yang Chen +2
AI-mediated heads-up augmented reality (AR) replaces fixed interfaces with dynamically adapting ones that decide what information to present, in what form, and when, based on a con…
Navigation beyond Wayfinding: Robots Collaborating with Visually Impaired Users for Environmental Interactions
Shaojun Cai, Nuwan Janaka, Ashwin Ram +4
Robotic guidance systems have shown promise in supporting blind and visually impaired (BVI) individuals with wayfinding and obstacle avoidance. However, most existing systems assum…
Progressive Sentences: Combining the Benefits of Word and Sentence Learning
Nuwan Janaka, Shengdong Zhao, Ashwin Ram +4
The rapid evolution of lightweight consumer augmented reality (AR) smart glasses (a.k.a. optical see-through head-mounted displays) offers novel opportunities for learning, particu…
WSCoach: Wearable Real-time Auditory Feedback for Reducing Unwanted Words in Daily Communication
Zhang Youpeng, Nuwan Janaka, Ashwin Ram +4
The rise of wearable smart devices raises unprecedented opportunities for self-improvement through ubiquitous behavior tracking and guidance. However, the design of effective weara…
Robi Butler: Multimodal Remote Interaction with a Household Robot Assistant
Anxing Xiao, Nuwan Janaka, Tianrun Hu +4
Imagine a future when we can Zoom-call a robot to manage household chores remotely. This work takes one step in this direction. Robi Butler is a new household robot assistant that…
AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glasses
Runze Cai, Nuwan Janaka, Hyeongcheol Kim +4
Unlike the free exploration of childhood, the demands of daily life reduce our motivation to explore our surroundings, leading to missed opportunities for informal learning. Tradit…