From the 1 of 10 linked papers with an AI index.
10 papers
Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs
Serpil Karabüklü, Kanishka Misra, Shester Gueuwou +3
The paper presents ASL Minimal Translation Pairs (ASL-MTP), a benchmark of minimal translation pairs covering various linguistic phenomena in American Sign Language, and uses it to…
Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus Constructions
Wesley Scivetti, Ethan Wilcox, Nathan Schneider +2
Grasping the semantics of rare constructions (form-meaning pairings) has been shown to be a challenging problem that has currently only been solved by the largest LLMs. It remains…
Cross-Modal Taxonomic Generalization in (Vision-) Language Models
Tianyang Xu, Marcelo Sandoval-Castaneda, Karen Livescu +2
What is the interplay between semantic representations learned by language models (LM) from surface form alone to those learned from more grounded evidence? We study this question…
A systematic framework for generating novel experimental hypotheses from language models
Kanishka Misra, Najoung Kim
Neural language models (LMs) have been shown to capture complex linguistic patterns, yet their utility in understanding human language and more broadly, human cognition, remains de…
Hey, wait a minute: on at-issue sensitivity in Language Models
Sanghee J. Kim, Kanishka Misra
Evaluating the naturalness of dialogue in language models (LMs) is not trivial: notions of 'naturalness' vary, and scalable quantitative metrics remain limited. This study leverage…
Vision-and-Language Training Helps Deploy Taxonomic Knowledge but Does Not Fundamentally Alter It
Yulu Qin, Dheeraj Varghese, Adam Dahlgren Lindström +3
Does vision-and-language (VL) training change the linguistic representations of language models in meaningful ways? Most results in the literature have shown inconsistent or margin…