How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure

Michael Wilson, Jackson Petty, Robert Frank

Language models are typically evaluated on their success at predicting the distribution of specific words in specific contexts. Yet linguistic knowledge also encodes relationships…