76 citations · 116 across the 11 of their papers we have counts for
5 papers · 1 filter
Predicting Typological Features in WALS using Language Embeddings and Conditional Probabilities: ÚFAL Submission to the SIGTYP 2020 Shared Task
Martin Vastl, Daniel Zeman, Rudolf Rosa
We present our submission to the SIGTYP 2020 Shared Task on the prediction of typological features. We submit a constrained system, predicting typological features only based on th…
Measuring Memorization Effect in Word-Level Neural Networks Probing
Rudolf Rosa, Tomáš Musil, David Mareček
Multiple studies have probed representations emerging in neural networks trained for end-to-end NLP tasks and examined what word-level linguistic information may be encoded in the…
THEaiTRE: Artificial Intelligence to Write a Theatre Play
Rudolf Rosa, Ondřej Dušek, Tom Kocmi +10
We present THEaiTRE, a starting project aimed at automatic generation of theatre play scripts. This paper reviews related work and drafts an approach we intend to follow. We plan t…
Universal Dependencies according to BERT: both more specific and more general
Tomasz Limisiewicz, Rudolf Rosa, David Mareček
This work focuses on analyzing the form and extent of syntactic abstraction captured by BERT by extracting labeled dependency trees from self-attentions. Previous work showed that…
On the Language Neutrality of Pre-trained Multilingual Representations
Jindřich Libovický, Rudolf Rosa, Alexander Fraser
Multilingual contextual embeddings, such as multilingual BERT and XLM-RoBERTa, have proved useful for many multi-lingual tasks. Previous work probed the cross-linguality of the rep…