139 citations · 462 across the 39 of their papers we have counts for
41 papers
The Emergent Symbolic Structure of Artificial Neural Networks
R. Thomas McCoy, Paul Soulos, Tal Linzen +1
Modern systems in artificial intelligence (AI) somehow excel in domains for which they seem poorly suited. Intelligence has traditionally been modeled as operating over structured…
A Unifying Perspective on Language Model Representations: From Filler-Role Structure to Mechanistic Interpretability
Zhang Enyan, R. Thomas McCoy
A wide range of methods have been proposed for interpreting language models, delivering important insights into their inner workings. However, different methods and their resulting…
Causal Interventions on Continuous Variables: A Case Study on Verb Bias in Steering Vectors for In-Context Learning
Zhenghao Herbert Zhou, R. Thomas McCoy, Robert Frank
Causal interventions in language model representations have largely targeted discrete features, like grammatical number. However, language models must also make use of features tha…
Collocational bootstrapping: A hypothesis about the learning of subject-verb agreement in humans and neural networks
Claire Hobbs, R. Thomas McCoy
In what ways might statistical signals in linguistic input assist with the acquisition of syntax? Here we hypothesize a mechanism called collocational bootstrapping, in which regul…
What Exactly do Children Receive in Language Acquisition? A Case Study on CHILDES with Automated Detection of Filler-Gap Dependencies
Zhenghao Herbert Zhou, William Dai, Maya Viswanathan +3
Children's acquisition of filler-gap dependencies has been argued by some to depend on innate grammatical knowledge, while others suggest that the distributional evidence available…
Evaluating the Usage of African-American Vernacular English in Large Language Models
Deja Dunlap, R. Thomas McCoy
In AI, most evaluations of natural language understanding tasks are conducted in standardized dialects such as Standard American English (SAE). In this work, we investigate how acc…