3 papers
cs.CL2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes
Tomasz Limisiewicz, David Mareček
State-of-the-art contextual embeddings are obtained from large language models available only for a few languages. For others, we need to learn representations using a multilingual…
cs.CL2021
THEaiTRE 1.0: Interactive generation of theatre play scripts
Rudolf Rosa, Tomáš Musil, Ondřej Dušek +13
We present the first version of a system for interactive generation of theatre play scripts. The system is based on a vanilla GPT-2 model with several adjustments, targeting specif…
cs.CL2020
Universal Dependencies according to BERT: both more specific and more general
Tomasz Limisiewicz, Rudolf Rosa, David Mareček
This work focuses on analyzing the form and extent of syntactic abstraction captured by BERT by extracting labeled dependency trees from self-attentions. Previous work showed that…