4 papers
On the Relation between Syntactic Divergence and Zero-Shot Performance
Ofir Arviv, Dmitry Nikolaev, Taelin Karidi +1
We explore the link between the extent to which syntactic relations are preserved in translation and the ease of correctly constructing a parse tree in a zero-shot setting. While p…
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords
Taelin Karidi, Yichu Zhou, Nathan Schneider +2
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond…
Fine-Grained Analysis of Cross-Linguistic Syntactic Divergences
Dmitry Nikolaev, Ofir Arviv, Taelin Karidi +4
The patterns in which the syntax of different languages converges and diverges are often used to inform work on cross-lingual transfer. Nevertheless, little empirical work has been…
Topological Analysis of Syntactic Structures
Alexander Port, Taelin Karidi, Matilde Marcolli
We use the persistent homology method of topological data analysis and dimensional analysis techniques to study data of syntactic structures of world languages. We analyze relation…