1 citations · 2 across the 8 of their papers we have counts for
10 papers
RunyaNER: Auxiliary Language Selection for Runyankore NER
Prosper Arineitwe Asiimwe, Francois Meyer, Jan Buys
Cross-lingual zero-shot transfer and multilingual fine-tuning are promising approaches for NLP tasks such as Named Entity Recognition (NER) in low-resource languages, but in the ab…
The Geometry of Low-Resource Language Representations
Francois Meyer, Jan Buys
The performance gap between low- and high-resource languages in LLMs is widely known, but it remains unclear which internal model factors drive these disparities. In this paper, we…
MzansiText and MzansiLM: An Open Corpus and Decoder-Only Language Model for South African Languages
Anri Lombard, Simbarashe Mawere, Temi Aina +5
Decoder-only language models can be adapted to diverse tasks through instruction finetuning, but the extent to which this generalizes at small scale for low-resource languages rema…
The Learning Dynamics of Subword Segmentation for Morphologically Diverse Languages
Francois Meyer, Jan Buys
Subword segmentation is typically applied in preprocessing and stays fixed during training. Alternatively, it can be learned during training to optimise the training objective. In…
A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation
Francois Meyer, Jan Buys
Multilingual modelling can improve machine translation for low-resource languages, partly through shared subword representations. This paper studies the role of subword segmentatio…
Triples-to-isiXhosa (T2X): Addressing the Challenges of Low-Resource Agglutinative Data-to-Text Generation
Francois Meyer, Jan Buys
Most data-to-text datasets are for English, so the difficulties of modelling data-to-text for low-resource languages are largely unexplored. In this paper we tackle data-to-text fo…
Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation
Francois Meyer, Jan Buys
Subword segmenters like BPE operate as a preprocessing step in neural machine translation and other (conditional) language models. They are applied to datasets before training, so…
University of Cape Town's WMT22 System: Multilingual Machine Translation for Southern African Languages
Khalid N. Elmadani, Francois Meyer, Jan Buys
The paper describes the University of Cape Town's submission to the constrained track of the WMT22 Shared Task: Large-Scale Machine Translation Evaluation for African Languages. Ou…
Subword Segmental Language Modelling for Nguni Languages
Francois Meyer, Jan Buys
Subwords have become the standard units of text in NLP, enabling efficient open-vocabulary models. With algorithms like byte-pair encoding (BPE), subword segmentation is viewed as…
Modelling Lexical Ambiguity with Density Matrices
Francois Meyer, Martha Lewis
Words can have multiple senses. Compositional distributional models of meaning have been argued to deal well with finer shades of meaning variation known as polysemy, but are not s…