33 citations · 50 across the 10 of their papers we have counts for
11 papers
MorphPiece : A Linguistic Tokenizer for Large Language Models
Haris Jabbar
Tokenization is a critical part of modern NLP pipelines. However, contemporary tokenizers for Large Language Models are based on statistical analysis of text corpora, without much…
Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging
Aarne Talman, Hande Celikkanat, Sami Virpioja +2
This paper introduces Bayesian uncertainty modeling using Stochastic Weight Averaging-Gaussian (SWAG) in Natural Language Understanding (NLU) tasks. We apply the approach to standa…
Democratizing Neural Machine Translation with OPUS-MT
Jörg Tiedemann, Mikko Aulamo, Daria Bakshandaeva +7
This paper presents the OPUS ecosystem with a focus on the development of open machine translation models and tools, and their integration into end-user applications, development p…
FinChat: Corpus and evaluation setup for Finnish chat conversations on everyday topics
Katri Leino, Juho Leinonen, Mittul Singh +2
Creating open-domain chatbots requires large amounts of conversational data and related benchmark tasks to evaluate them. Standardized evaluation tasks are crucial for creating aut…
Effects of Language Relatedness for Cross-lingual Transfer Learning in Character-Based Language Models
Mittul Singh, Peter Smit, Sami Virpioja +1
Character-based Neural Network Language Models (NNLM) have the advantage of smaller vocabulary and thus faster training times in comparison to NNLMs based on multi-character units.…
Subword RNNLM Approximations for Out-Of-Vocabulary Keyword Search
Mittul Singh, Sami Virpioja, Peter Smit +1
In spoken Keyword Search, the query may contain out-of-vocabulary (OOV) words not observed when training the speech recognition system. Using subword language models (LMs) in the f…
Transfer learning and subword sampling for asymmetric-resource one-to-many neural translation
Stig-Arne Grönroos, Sami Virpioja, Mikko Kurimo
There are several approaches for improving neural machine translation for low-resource languages: Monolingual data can be exploited via pretraining or data augmentation; Parallel c…
Morfessor EM+Prune: Improved Subword Segmentation with Expectation Maximization and Pruning
Stig-Arne Grönroos, Sami Virpioja, Mikko Kurimo
Data-driven segmentation of words into subword units has been used in various natural language processing applications such as automatic speech recognition and statistical machine…
The University of Helsinki submissions to the WMT19 news translation task
Aarne Talman, Umut Sulubacak, Raúl Vázquez +5
In this paper, we present the University of Helsinki submissions to the WMT 2019 shared task on news translation in three language pairs: English-German, English-Finnish and Finnis…
Cognate-aware morphological segmentation for multilingual neural translation
Stig-Arne Grönroos, Sami Virpioja, Mikko Kurimo
This article describes the Aalto University entry to the WMT18 News Translation Shared Task. We participate in the multilingual subtrack with a system trained under the constrained…
Automatic Speech Recognition with Very Large Conversational Finnish and Estonian Vocabularies
Seppo Enarvi, Peter Smit, Sami Virpioja +1
Today, the vocabulary size for language models in large vocabulary speech recognition is typically several hundreds of thousands of words. While this is already sufficient in some…