5 papers · 1 filter
StreetReaderAI: Making Street View Accessible Using Context-Aware Multimodal AI
Jon E. Froehlich, Alexander Fiannaca, Nimer Jaber +2
Interactive streetscape mapping tools such as Google Street View (GSV) and Meta Mapillary enable users to virtually navigate and experience real-world environments via immersive 36…
"Does the cafe entrance look accessible? Where is the door?" Towards Geospatial AI Agents for Visual Inquiries
Jon E. Froehlich, Jared Hwang, Zeyu Wang +7
Interactive digital maps have revolutionized how people travel and learn about the world; however, they rely on pre-existing structured data in GIS databases (e.g., road networks,…
ArtInsight: Enabling AI-Powered Artwork Engagement for Mixed Visual-Ability Families
Arnavi Chheda-Kothary, Ritesh Kanchi, Chris Sanders +5
We introduce ArtInsight, a novel AI-powered system to facilitate deeper engagement with child-created artwork in mixed visual-ability families. ArtInsight leverages large language…
Engaging with Children's Artwork in Mixed Visual-Ability Families
Arnavi Chheda-Kothary, Jacob O. Wobbrock, Jon E. Froehlich
We present two studies exploring how blind or low-vision (BLV) family members engage with their sighted children's artwork, strategies to support understanding and interpretation,…
CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low Vision
Jaewook Lee, Andrew D. Tjahjadi, Jiho Kim +6
Cooking is a central activity of daily living, supporting independence as well as mental and physical health. However, prior work has highlighted key barriers for people with low v…