343 citations · 489 across the 23 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 17 cited
The MultiBERTs: BERT Reproductions for Robustness Analysis
Thibault Sellam, Steve Yadlowsky, Jason Wei +9
Experiments with pre-trained models such as BERT are often based on a single checkpoint. While the conclusions drawn apply to the artifact tested in the experiment (i.e., the parti…
cs.CL2021
A Non-Linear Structural Probe
Jennifer C. White, Tiago Pimentel, Naomi Saphra +1
Probes are models devised to investigate the encoding of knowledge -- e.g. syntactic structure -- in contextual representations. Probes are often designed for simplicity, which has…