Uncovering Constraint-Based Behavior in Neural Models via Targeted Fine-Tuning

Forrest Davis, Marten van Schijndel

A growing body of literature has focused on detailing the linguistic knowledge embedded in large, pretrained language models. Existing work has shown that non-linguistic biases in…