The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments
arXiv:1805.01515 · doi:10.1145/3134756
Abstract
Like sighted people, visually impaired people want to share photographs on social networking services, but find it difficult to identify and select photos from their albums. We aimed to address this problem by incorporating state-of-the-art computer-generated descriptions into Facebook's photo-sharing feature. We interviewed 12 visually impaired participants to understand their photo-sharing experiences and designed a photo description feature for the Facebook mobile application. We evaluated this feature with six participants in a seven-day diary study. We found that participants used the descriptions to recall and organize their photos, but they hesitated to upload photos without a sighted person's input. In addition to basic information about photo content, participants wanted to know more details about salient objects and people, and whether the photos reflected their personal aesthetics. We discuss these findings from the lens of self-disclosure and self-presentation theories and propose new computer vision research directions that will better support visual content sharing by visually impaired people.
arXiv commentCSCW 2018
Cited by in corpus (8)
- "It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality
- "It Feels Like Taking a Gamble": Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments
- Computer Vision and Conflicting Values: Describing People with Automated Alt Text
- Misfitting With AI: How Blind People Verify and Contest AI Errors
- Helping Visually Impaired People Take Better Quality Pictures
- EditScribe: Non-Visual Image Editing with Natural Language Verification Loops
- Communicating Visualizations without Visuals: Investigation of Visualization Alternative Text for People with Visual Impairments
- Barriers and Opportunities to Accessible Social Media Content Authoring