Competence-Based Analysis of Language Models

Adam Davies, Jize Jiang, ChengXiang Zhai

Despite the recent successes of large, pretrained neural language models (LLMs), comparatively little is known about the representations of linguistic structure they learn during p…