42 citations · 48 across the 2 of their papers we have counts for
7 papers · 1 filter
Evaluation of contextual embeddings on less-resourced languages
Matej Ulčar, Aleš Žagar, Carlos S. Armendariz +4
The current dominance of deep neural networks in natural language processing is based on contextual embeddings such as ELMo, BERT, and BERT derivatives. Most existing work focuses…
CoSimLex: A Resource for Evaluating Graded Word Similarity in Context
Carlos Santos Armendariz, Matthew Purver, Matej Ulčar +5
State of the art natural language processing tools are built on context-dependent word embeddings, but no direct method for evaluating these representations currently exists. Stand…
Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shift
Matej Martinc, Petra Kralj Novak, Senja Pollak
We propose a new method that leverages contextual embeddings for the task of diachronic semantic shift detection by generating time specific word representations from BERT embeddin…
Supervised and Unsupervised Neural Approaches to Text Readability
Matej Martinc, Senja Pollak, Marko Robnik-Šikonja
We present a set of novel neural supervised and unsupervised approaches for determining the readability of documents. In the unsupervised setting, we leverage neural language model…
Language comparison via network topology
Blaž Škrlj, Senja Pollak
Modeling relations between languages can offer understanding of language characteristics and uncover similarities and differences between languages. Automated methods applied to la…
RaKUn: Rank-based Keyword extraction via Unsupervised learning and Meta vertex aggregation
Blaž Škrlj, Andraž Repar, Senja Pollak
Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text-based systems. W…