6 citations · 13 across the 13 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CL2022
Testing Pre-trained Language Models' Understanding of Distributivity via Causal Mediation Analysis
Pangbo Ban, Yifan Jiang, Tianran Liu +1
To what extent do pre-trained language models grasp semantic knowledge regarding the phenomenon of distributivity? In this paper, we introduce DistNLI, a new diagnostic dataset for…
cs.CL2022
Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models
David K. Yi, James V. Bruno, Jiayu Han +2
We investigate the extent to which verb alternation classes, as described by Levin (1993), are encoded in the embeddings of Large Pre-trained Language Models (PLMs) such as BERT, R…
cs.CL2022
Learning to translate by learning to communicate
C. M. Downey, Xuhui Zhou, Leo Z. Liu +1
We formulate and test a technique to use Emergent Communication (EC) with a pre-trained multilingual model to improve on modern Unsupervised NMT systems, especially for low-resourc…