2 citations · 6 across the 17 of their papers we have counts for
4 papers · 1 filter
Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations
Arabella Sinclair, Jaap Jumelet, Willem Zuidema +1
We investigate the extent to which modern, neural language models are susceptible to structural priming, the phenomenon whereby the structure of a sentence makes the same structure…
Language Models Use Monotonicity to Assess NPI Licensing
Jaap Jumelet, Milica Denić, Jakub Szymanik +2
We investigate the semantic knowledge of language models (LMs), focusing on (1) whether these LMs create categories of linguistic environments based on their semantic monotonicity…
Attention vs non-attention for a Shapley-based explanation method
Tom Kersten, Hugh Mee Wong, Jaap Jumelet +1
The field of explainable AI has recently seen an explosion in the number of explanation methods for highly non-linear deep neural networks. The extent to which such methods -- that…
Language Modelling as a Multi-Task Problem
Lucas Weber, Jaap Jumelet, Elia Bruni +1
In this paper, we propose to study language modelling as a multi-task problem, bringing together three strands of research: multi-task learning, linguistics, and interpretability.…