13 citations · 15 across the 2 of their papers we have counts for
3 papers
cs.CL2019★ 13 cited
Inducing Syntactic Trees from BERT Representations
Rudolf Rosa, David Mareček
We use the English model of BERT and explore how a deletion of one word in a sentence changes representations of other words. Our hypothesis is that removing a reducible word (e.g.…
cs.CL2019
From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions
David Mareček, Rudolf Rosa
We inspect the multi-head self-attention in Transformer NMT encoders for three source languages, looking for patterns that could have a syntactic interpretation. In many of the att…
cs.CL2015★ 2 cited
Parsing Natural Language Sentences by Semi-supervised Methods
Rudolf Rosa
We present our work on semi-supervised parsing of natural language sentences, focusing on multi-source crosslingual transfer of delexicalized dependency parsers. We first evaluate…