1 citations · 3 across the 6 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Examining the Inductive Bias of Neural Language Models with Artificial Languages
Jennifer C. White, Ryan Cotterell
Since language models are used to model a wide variety of languages, it is natural to ask whether the neural architectures used for the task have inductive biases towards modeling…
cs.CL2021
A Non-Linear Structural Probe
Jennifer C. White, Tiago Pimentel, Naomi Saphra +1
Probes are models devised to investigate the encoding of knowledge -- e.g. syntactic structure -- in contextual representations. Probes are often designed for simplicity, which has…