263 citations · 335 across the 8 of their papers we have counts for
6 papers · 1 filter
Evaluating Transferability of BERT Models on Uralic Languages
Judit Ács, Dániel Lévai, András Kornai
Transformer-based language models such as BERT have outperformed previous models on a large number of English benchmarks, but their evaluation is often limited to English or a smal…
Subword Pooling Makes a Difference
Judit Ács, Ákos Kádár, András Kornai
Contextual word-representations became a standard in modern natural language processing systems. These models use subword tokenization to handle large vocabularies and unknown word…
Evaluating Contextualized Language Models for Hungarian
Judit Ács, Dániel Lévai, Dávid Márk Nemeskey +1
We present an extended comparison of contextualized language models for Hungarian. We compare huBERT, a Hungarian model against 4 multilingual models including the multilingual BER…
The Role of Interpretable Patterns in Deep Learning for Morphology
Judit Acs, Andras Kornai
We examine the role of character patterns in three tasks: morphological analysis, lemmatization and copy. We use a modified version of the standard sequence-to-sequence model, wher…
Sentence Length
Gábor Borbély, András Kornai
The distribution of sentence length in ordinary language is not well captured by the existing models. Here we survey previous models of sentence length and present our random walk…
A practical approach to language complexity: a Wikipedia case study
Taha Yasseri, András Kornai, János Kertész
In this paper we present statistical analysis of English texts from Wikipedia. We try to address the issue of language complexity empirically by comparing the simple English Wikipe…