16 citations · 33 across the 7 of their papers we have counts for
7 papers
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese
Kurt Micallef, Albert Gatt, Marc Tanti +2
Multilingual language models such as mBERT have seen impressive cross-lingual transfer to a variety of languages, but many languages remain excluded from these models. In this pape…
Face2Text revisited: Improved data set and baseline results
Marc Tanti, Shaun Abdilla, Adrian Muscat +3
Current image description generation models do not transfer well to the task of describing human faces. To encourage the development of more human-focused descriptions, we develope…
Analysis of Data Augmentation Methods for Low-Resource Maltese ASR
Andrea DeMarco, Carlos Mena, Albert Gatt +3
Recent years have seen an increased interest in the computational speech processing of Maltese, but resources remain sparse. In this paper, we consider data augmentation techniques…
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning
Marc Tanti, Lonneke van der Plas, Claudia Borg +1
Recent work has shown evidence that the knowledge acquired by multilingual BERT (mBERT) has two components: a language-specific and a language-neutral one. This paper analyses the…
MASRI-HEADSET: A Maltese Corpus for Speech Recognition
Carlos Mena, Albert Gatt, Andrea DeMarco +4
Maltese, the national language of Malta, is spoken by approximately 500,000 people. Speech processing for Maltese is still in its early stages of development. In this paper, we pre…
Face2Text: Collecting an Annotated Image Description Corpus for the Generation of Rich Face Descriptions
Albert Gatt, Marc Tanti, Adrian Muscat +6
The past few years have witnessed renewed interest in NLP tasks at the interface between vision and language. One intensively-studied problem is that of automatically generating te…
Morphological Analysis for the Maltese Language: The Challenges of a Hybrid System
Claudia Borg, Albert Gatt
Maltese is a morphologically rich language with a hybrid morphological system which features both concatenative and non-concatenative processes. This paper analyses the impact of t…