99 citations · 330 across the 75 of their papers we have counts for
11 papers · 1 filter
On the Relation between Syntactic Divergence and Zero-Shot Performance
Ofir Arviv, Dmitry Nikolaev, Taelin Karidi +1
We explore the link between the extent to which syntactic relations are preserved in translation and the ease of correctly constructing a parse tree in a zero-shot setting. While p…
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords
Taelin Karidi, Yichu Zhou, Nathan Schneider +2
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond…
Semantics-aware Attention Improves Neural Machine Translation
Aviv Slobodkin, Leshem Choshen, Omri Abend
The integration of syntactic structures into Transformer machine translation has shown positive results, but to our knowledge, no work has attempted to do so with semantic structur…
On Neurons Invariant to Sentence Structural Changes in Neural Machine Translation
Gal Patel, Leshem Choshen, Omri Abend
We present a methodology that explores how sentence structure is reflected in neural representations of machine translation systems. We demonstrate our model-agnostic approach with…
Cross-linguistically Consistent Semantic and Syntactic Annotation of Child-directed Speech
Ida Szubert, Omri Abend, Nathan Schneider +4
This paper proposes a methodology for constructing such corpora of child directed speech (CDS) paired with sentential logical forms, and uses this method to create two such corpora…
The Grammar-Learning Trajectories of Neural Language Models
Leshem Choshen, Guy Hacohen, Daphna Weinshall +1
The learning trajectories of linguistic phenomena in humans provide insight into linguistic representation, beyond what can be gleaned from inspecting the behavior of an adult spea…