7 papers
Intent Lenses: Inferring Capture-Time Intent to Transform Opportunistic Photo Captures into Structured Visual Notes
Ashwin Ram, Aeneas Leon Sommer, Martin Schmitz +1
Opportunistic photo capture (e.g., slides, exhibits, or artifacts) is a common strategy for preserving information encountered in information-rich environments for later revisitati…
Beyond Descriptions: A Generative Scene2Audio Framework for Blind and Low-Vision Users to Experience Vista Landscapes
Chitralekha Gupta, Jing Peng, Ashwin Ram +3
Current scene perception tools for Blind and Low Vision (BLV) individuals rely on spoken descriptions but lack engaging representations of visually pleasing distant environmental l…
Navigation beyond Wayfinding: Robots Collaborating with Visually Impaired Users for Environmental Interactions
Shaojun Cai, Nuwan Janaka, Ashwin Ram +4
Robotic guidance systems have shown promise in supporting blind and visually impaired (BVI) individuals with wayfinding and obstacle avoidance. However, most existing systems assum…
GestureCoach: Rehearsing for Engaging Talks with LLM-Driven Gesture Recommendations
Ashwin Ram, Varsha Suresh, Artin Saberpour Abadian +2
This paper introduces GestureCoach, a system designed to help speakers deliver more engaging talks by guiding them to gesture effectively during rehearsal. GestureCoach combines an…
Progressive Sentences: Combining the Benefits of Word and Sentence Learning
Nuwan Janaka, Shengdong Zhao, Ashwin Ram +4
The rapid evolution of lightweight consumer augmented reality (AR) smart glasses (a.k.a. optical see-through head-mounted displays) offers novel opportunities for learning, particu…
WSCoach: Wearable Real-time Auditory Feedback for Reducing Unwanted Words in Daily Communication
Zhang Youpeng, Nuwan Janaka, Ashwin Ram +4
The rise of wearable smart devices raises unprecedented opportunities for self-improvement through ubiquitous behavior tracking and guidance. However, the design of effective weara…