331 citations · 600 across the 21 of their papers we have counts for
5 papers · 1 filter
Towards Fully Bilingual Deep Language Modeling
Li-Hsin Chang, Sampo Pyysalo, Jenna Kanerva +1
Language models based on deep neural networks have facilitated great advances in natural language processing and understanding tasks in recent years. While models covering a large…
The birth of Romanian BERT
Stefan Daniel Dumitrescu, Andrei-Marius Avram, Sampo Pyysalo
Large-scale pretrained language models have become ubiquitous in Natural Language Processing. However, most of these models are available either in high-resource languages, in part…
WikiBERT models: deep transfer learning for many languages
Sampo Pyysalo, Jenna Kanerva, Antti Virtanen +1
Deep neural language models such as BERT have enabled substantial recent advances in many natural language processing tasks. Due to the effort and computational cost involved in th…
Exploring Cross-sentence Contexts for Named Entity Recognition with BERT
Jouni Luoma, Sampo Pyysalo
Named entity recognition (NER) is frequently addressed as a sequence classification task where each input consists of one sentence of text. It is nevertheless clear that useful inf…
Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection
Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter +6
Universal Dependencies is an open community effort to create cross-linguistically consistent treebank annotation for many languages within a dependency-based lexicalist framework.…