6 citations · 17 across the 12 of their papers we have counts for
10 papers · 1 filter
CommVQA: Situating Visual Question Answering in Communicative Contexts
Nandita Shankar Naik, Christopher Potts, Elisa Kreiss
Current visual question answering (VQA) models tend to be trained and evaluated on image-question pairs in isolation. However, the questions people ask are dependent on their infor…
ContextRef: Evaluating Referenceless Metrics For Image Description Generation
Elisa Kreiss, Eric Zelikman, Christopher Potts +1
Referenceless metrics (e.g., CLIPScore) use pretrained vision--language models to assess image descriptions directly without costly ground-truth reference texts. Such methods can f…
Context-VQA: Towards Context-Aware and Purposeful Visual Question Answering
Nandita Naik, Christopher Potts, Elisa Kreiss
Visual question answering (VQA) has the potential to make the Internet more accessible in an interactive way, allowing people who cannot see images to ask questions about them. How…
Color Overmodification Emerges from Data-Driven Learning and Pragmatic Reasoning
Fei Fang, Kunal Sinha, Noah D. Goodman +2
Speakers' referential expressions often depart from communicative ideals in ways that help illuminate the nature of pragmatic language use. Patterns of overmodification, in which a…
Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics
Elisa Kreiss, Cynthia Bennett, Shayan Hooshmand +3
Few images on the Web receive alt-text descriptions that would make them accessible to blind and low vision (BLV) users. Image-based NLG systems have progressed to the point where…
Causal Distillation for Language Models
Zhengxuan Wu, Atticus Geiger, Josh Rozner +5
Distillation efforts have led to language models that are more compact and efficient without serious drops in performance. The standard approach to distillation trains a student mo…
ReaSCAN: Compositional Reasoning in Language Grounding
Zhengxuan Wu, Elisa Kreiss, Desmond C. Ong +1
The ability to compositionally map language to referents, relations, and actions is an essential component of language understanding. The recent gSCAN dataset (Ruis et al. 2020, Ne…
Concadia: Towards Image-Based Text Generation with a Purpose
Elisa Kreiss, Fei Fang, Noah D. Goodman +1
Current deep learning models often achieve excellent results on benchmark image-to-text datasets but fail to generate texts that are useful in practice. We argue that to close this…
Modeling Subjective Assessments of Guilt in Newspaper Crime Narratives
Elisa Kreiss, Zijian Wang, Christopher Potts
Crime reporting is a prevalent form of journalism with the power to shape public perceptions and social policies. How does the language of these reports act on readers? We seek to…
When redundancy is useful: A Bayesian approach to 'overinformative' referring expressions
Judith Degen, Robert D. Hawkins, Caroline Graf +2
Referring is one of the most basic and prevalent uses of language. How do speakers choose from the wealth of referring expressions at their disposal? Rational theories of language…