2 citations · 6 across the 16 of their papers we have counts for
16 papers
Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance
Jiazhao Liang, Hao Huang, Shuaihang Yuan +8
Vision-language models (VLMs) are rapidly progressing and offer promising capabilities for assistive technologies supporting persons with blindness or low vision. However, existing…
SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Update
Diwei Sheng, Vijayraj Gohil, Satyam Gaba +5
Long-term autonomy in mobile robotics requires maps that remain accurate as environments change over time. Visual Place Recognition (VPR), a core localization capability, degrades…
Evaluating OCR Performance for Assistive Technology: Effects of Walking Speed, Camera Placement, and Camera Type
Junchi Feng, Nikhil Ballem, Mahya Beheshti +5
Optical character recognition (OCR), a process that converts printed or handwritten text into machine-readable form, is widely used in assistive technology for people with blindnes…
Exploring the Use of VLMs for Navigation Assistance for People with Blindness and Low Vision
Yu Li, Yuchen Zheng, Giles Hamilton-Fletcher +6
This paper investigates the potential of vision-language models (VLMs) to assist people with blindness and low vision (pBLV) in navigation tasks. We evaluate state-of-the-art close…
A Multimodal Assistive System for Product Localization and Retrieval for People who are Blind or have Low Vision
Ligao Ruan, Giles Hamilton-Fletcher, Mahya Beheshti +3
Shopping is a routine activity for sighted individuals, yet for people who are blind or have low vision (pBLV), locating and retrieving products in physical environments remains a…
Does Embodiment Matter to Biomechanics and Function? A Comparative Analysis of Head-Mounted and Hand-Held Assistive Devices for Individuals with Blindness and Low Vision
Gaurav Seth, Hoa Pham, Giles Hamilton-Fletcher +2
Visual assistive technologies, such as Microsoft Seeing AI, can improve access to environmental information for persons with blindness or low vision (pBLV). Yet, the physical and f…
Residual Gaze Behavior During Navigation in Blindness and Low Vision
Junchi Feng, Fernanda Garcia-Pina, Mahya Beheshti +3
Background: Outdoor navigation poses significant challenges for people with blindness or low vision, yet the role of gaze behavior in supporting mobility remains underexplored. Ful…
Robust Computer-Vision based Construction Site Detection for Assistive-Technology Applications
Junchi Feng, Giles Hamilton-Fletcher, Nikhil Ballem +5
Purpose: Navigating urban environments poses significant challenges for individuals who are blind or have low vision, especially in areas affected by construction. Construction zon…
Integrating Retrospective Framework in Multi-Robot Collaboration
Jiazhao Liang, Hao Huang, Yu Hao +4
Recent advancements in Large Language Models (LLMs) have demonstrated substantial capabilities in enhancing communication and coordination in multi-robot systems. However, existing…
Multi-faceted Sensory Substitution for Curb Alerting: A Pilot Investigation in Persons with Blindness and Low Vision
Ligao Ruan, Giles Hamilton-Fletcher, Mahya Beheshti +3
Curbs -- the edge of a raised sidewalk at the point where it meets a street -- crucial in urban environments where they help delineate safe pedestrian zones, from dangerous vehicul…
Haptics-based, higher-order Sensory Substitution designed for Object Negotiation in Blindness and Low Vision: Virtual Whiskers
Junchi Feng, Giles Hamilton-Fletcher, Todd E Hudson +3
People with blindness and low vision (pBLV) face challenges in navigating. Mobility aids are crucial for enhancing independence and safety. This paper presents an electronic travel…
Can Foundation Models Reliably Identify Spatial Hazards? A Case Study on Curb Segmentation
Diwei Sheng, Giles Hamilton-Fletcher, Mahya Beheshti +2
Curbs serve as vital borders that delineate safe pedestrian zones from potential vehicular traffic hazards. Curbs also represent a primary spatial hazard during dynamic navigation…
NYC-Indoor-VPR: A Long-Term Indoor Visual Place Recognition Dataset with Semi-Automatic Annotation
Diwei Sheng, Anbang Yang, John-Ross Rizzo +1
Visual Place Recognition (VPR) in indoor environments is beneficial to humans and robots for better localization and navigation. It is challenging due to appearance changes at vari…
5G Edge Vision: Wearable Assistive Technology for People with Blindness and Low Vision
Tommy Azzino, Marco Mezzavilla, Sundeep Rangan +2
In an increasingly visual world, people with blindness and low vision (pBLV) face substantial challenges in navigating their surroundings and interpreting visual information. From…
A Multi-Modal Foundation Model to Assist People with Blindness and Low Vision in Environmental Interaction
Yu Hao, Fan Yang, Hao Huang +5
People with blindness and low vision (pBLV) encounter substantial challenges when it comes to comprehensive scene recognition and precise object identification in unfamiliar enviro…
Distillation Improves Visual Place Recognition for Low Quality Images
Anbang Yang, Ge Jin, Junjie Huang +3
Real-time visual localization often utilizes online computing, for which query images or videos are transmitted to remote servers for visual place recognition (VPR). However, limit…