6 papers
Are Large Vision-Language Models Ready to Guide Blind and Low-Vision Individuals?
Eunki Kim, Na Min An, Wan Ju Kang +3
Large Vision-Language Models (LVLMs) demonstrate a promising direction for assisting individuals with blindness or low-vision (BLV). Yet, measuring their true utility in real-world…
How Blind and Low-Vision Individuals Prefer Large Vision-Language Model-Generated Scene Descriptions
Na Min An, Eunki Kim, Wan Ju Kang +3
For individuals with blindness or low vision (BLV), navigating complex environments can pose serious risks. Large Vision-Language Models (LVLMs) show promise for generating scene d…
Learning to Insert [PAUSE] Tokens for Better Reasoning
Eunki Kim, Sangryul Kim, James Thorne
To enhance reasoning capabilities, previous works have explored incorporating special-purpose tokens into the training process. These strategies strengthen the learning mechanism o…
From Evidence to Belief: A Bayesian Epistemology Approach to Language Models
Minsu Kim, Sangryul Kim, James Thorne
This paper investigates the knowledge of language models from the perspective of Bayesian epistemology. We explore how language models adjust their confidence and responses when pr…
Sightation Counts: Leveraging Sighted User Feedback in Building a BLV-aligned Dataset of Diagram Descriptions
Wan Ju Kang, Eunki Kim, Na Min An +4
Often, the needs and visual abilities differ between the annotator group and the end user group. Generating detailed diagram descriptions for blind and low-vision (BLV) users is on…
Context Filtering with Reward Modeling in Question Answering
Sangryul Kim, James Thorne
Question Answering (QA) in NLP is the task of finding answers to a query within a relevant context retrieved by a retrieval system. Yet, the mix of relevant and irrelevant informat…