3 citations · 6 across the 5 of their papers we have counts for
5 papers
Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models
Jingyi Xie, Rui Yu, He Zhang +3
Large multimodal models (LMMs) have enabled new AI-powered applications that help people with visual impairments (PVI) receive natural language descriptions of their surroundings t…
Emerging Practices for Large Multimodal Model (LMM) Assistance for People with Visual Impairments: Implications for Design
Jingyi Xie, Rui Yu, He Zhang +3
People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large v…
ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworks
Saad Hassan, Matthew Seita, Larwan Berke +4
We are releasing a dataset containing videos of both fluent and non-fluent signers using American Sign Language (ASL), which were collected using a Kinect v2 sensor. This dataset w…
Feasibility of Interactive 3D Map for Remote Sighted Assistance
Jingyi Xie, Rui Yu, Sooyeon Lee +3
Remote sighted assistance (RSA) has emerged as a conversational assistive technology, where remote sighted workers, i.e., agents, provide real-time assistance to users with vision…
Conversations for Vision: Remote Sighted Assistants Helping People with Visual Impairments
Sooyeon Lee, Madison Reddie, Krish Gurdasani +4
People with visual impairment (PVI) must interact with a world they cannot see. Remote sighted assistance has emerged as a conversational/social support system. We interviewed part…