2 citations · 2 across the 3 of their papers we have counts for
4 papers · 1 filter
Examining form-based linguistic productivity in people and large language models
Michael Wilson, Robert Frank
Linguistic productivity, as evidenced by the use of words in novel contexts, is one of the most striking facts about human language. However, how abstract the knowledge that enable…
Representation of syntax in LLMs through the lens of linear distance and similarity-aware entropy
Juan Pablo Vigneaux, Mary Kennedy, Khalil Iskarous +2
Structural probes were introduced by Hewitt and Manning to reconstruct syntactic trees from a neural language model's latent representations. They are evaluated by calculating the…
Causal Interventions on Continuous Variables: A Case Study on Verb Bias in Steering Vectors for In-Context Learning
Zhenghao Herbert Zhou, R. Thomas McCoy, Robert Frank
Causal interventions in language model representations have largely targeted discrete features, like grammatical number. However, language models must also make use of features tha…
How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure
Michael Wilson, Jackson Petty, Robert Frank
Language models are typically evaluated on their success at predicting the distribution of specific words in specific contexts. Yet linguistic knowledge also encodes relationships…