Accessibility Scout: Personalized Accessibility Scans of Built Environments

Abstract

Assessing the accessibility of unfamiliar built environments is critical for people with disabilities. However, manual assessments, performed by users or their personal health professionals, are laborious and unscalable, while automatic machine learning methods often neglect an individual user's unique needs. Recent advances in Large Language Models (LLMs) enable novel approaches to this problem, balancing personalization with scalability to enable more adaptive and context-aware assessments of accessibility. We present Accessibility Scout, an LLM-based accessibility scanning system that identifies accessibility concerns from photos of built environments. With use, Accessibility Scout becomes an increasingly capable "accessibility scout", tailoring accessibility scans to an individual's mobility level, preferences, and specific environmental interests through collaborative Human-AI assessments. We present findings from three studies: a formative study with six participants to inform the design of Accessibility Scout, a technical evaluation of 500 images of built environments, and a user study with 10 participants of varying mobility. Results from our technical evaluation and user study show that Accessibility Scout can generate personalized accessibility scans that extend beyond traditional ADA considerations. Finally, we conclude with a discussion on the implications of our work and future steps for building more scalable and personalized accessibility assessments of the physical world.

18 pages, 16 figures. Presented at ACM UIST 2025

References in corpus (17)

• A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
• TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation
• Explainable AI: Beware of Inmates Running the Asylum Or: How I Learnt to Stop Worrying and Love the Social and Behavioural Sciences
• Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild
• Generating Automatic Feedback on UI Mockups with Large Language Models
• Writer-Defined AI Personas for On-Demand Feedback Generation
• Semantic-SAM: Segment and Recognize Anything at Any Granularity
• Is Trust Correlated With Explainability in AI? A Meta-Analysis
• Doing Personal LAPS: LLM-Augmented Dialogue Construction for Personalized Multi-Session Conversational Search
• Personalization of Large Language Models: A Survey
• Towards a Personal Health Large Language Model
• WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users
• ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Models
• LLM-Rec: Personalized Recommendation via Prompting Large Language Models
• The Many Facets of Trust in AI: Formalizing the Relation Between Trust and Fairness, Accountability, and Transparency
• Transforming Wearable Data into Personal Health Insights using Large Language Model Agents
• CoA-VLA: Improving Vision-Language-Action Models via Visual-Textual Chain-of-Affordance