76 citations · 116 across the 11 of their papers we have counts for
13 papers
Walks in the Fictional Woods
Victor Schetinger, Sara Di Bartolomeo, Edirlei Soares de Lima +2
This paper presents a novel exploration of the interaction between generative AI models, visualization, and narrative generation processes, using OpenAI's GPT as a case study. We l…
DialogueScript: Using Dialogue Agents to Produce a Script
Patrícia Schmidtová, Dávid Javorský, Christián Mikláš +3
We present a novel approach to generating scripts by using agents with different personality types. To manage character interaction in the script, we employ simulated dramatic netw…
THEaiTRE 1.0: Interactive generation of theatre play scripts
Rudolf Rosa, Tomáš Musil, Ondřej Dušek +13
We present the first version of a system for interactive generation of theatre play scripts. The system is based on a vanilla GPT-2 model with several adjustments, targeting specif…
Predicting Typological Features in WALS using Language Embeddings and Conditional Probabilities: ÚFAL Submission to the SIGTYP 2020 Shared Task
Martin Vastl, Daniel Zeman, Rudolf Rosa
We present our submission to the SIGTYP 2020 Shared Task on the prediction of typological features. We submit a constrained system, predicting typological features only based on th…
Measuring Memorization Effect in Word-Level Neural Networks Probing
Rudolf Rosa, Tomáš Musil, David Mareček
Multiple studies have probed representations emerging in neural networks trained for end-to-end NLP tasks and examined what word-level linguistic information may be encoded in the…
THEaiTRE: Artificial Intelligence to Write a Theatre Play
Rudolf Rosa, Ondřej Dušek, Tom Kocmi +10
We present THEaiTRE, a starting project aimed at automatic generation of theatre play scripts. This paper reviews related work and drafts an approach we intend to follow. We plan t…
Universal Dependencies according to BERT: both more specific and more general
Tomasz Limisiewicz, Rudolf Rosa, David Mareček
This work focuses on analyzing the form and extent of syntactic abstraction captured by BERT by extracting labeled dependency trees from self-attentions. Previous work showed that…
On the Language Neutrality of Pre-trained Multilingual Representations
Jindřich Libovický, Rudolf Rosa, Alexander Fraser
Multilingual contextual embeddings, such as multilingual BERT and XLM-RoBERTa, have proved useful for many multi-lingual tasks. Previous work probed the cross-linguality of the rep…
How Language-Neutral is Multilingual BERT?
Jindřich Libovický, Rudolf Rosa, Alexander Fraser
Multilingual BERT (mBERT) provides sentence representations for 104 languages, which are useful for many multi-lingual tasks. Previous work probed the cross-linguality of mBERT usi…
Unsupervised Lemmatization as Embeddings-Based Word Clustering
Rudolf Rosa, Zdeněk Žabokrtský
We focus on the task of unsupervised lemmatization, i.e. grouping together inflected forms of one word under one label (a lemma) without the use of annotated training data. We prop…
Inducing Syntactic Trees from BERT Representations
Rudolf Rosa, David Mareček
We use the English model of BERT and explore how a deletion of one word in a sentence changes representations of other words. Our hypothesis is that removing a reducible word (e.g.…
From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions
David Mareček, Rudolf Rosa
We inspect the multi-head self-attention in Transformer NMT encoders for three source languages, looking for patterns that could have a syntactic interpretation. In many of the att…
Parsing Natural Language Sentences by Semi-supervised Methods
Rudolf Rosa
We present our work on semi-supervised parsing of natural language sentences, focusing on multi-source crosslingual transfer of delexicalized dependency parsers. We first evaluate…