60 citations · 119 across the 36 of their papers we have counts for
13 papers · 1 filter
Georeferencing complex relative locality descriptions with large language models
Aneesha Fernando, Surangika Ranathunga, Kristin Stock +2
Georeferencing text documents has typically relied on either gazetteer-based methods to assign geographic coordinates to place names, or on language modelling approaches that assoc…
LMSpell: Spell Correction with Pre-Trained Language Models
Akesh Gunathilake, Nadil Karunarathna, Tharusha Bandaranayake +3
Spell correction is still a challenging problem for many languages, especially low-resource languages (LRLs). While pre-trained language models (PLMs) have been employed for spell…
Extracting Disaster Impacts and Impact Related Locations in Social Media Posts Using Large Language Models
Sameeah Noreen Hameed, Surangika Ranathunga, Raj Prasanna +2
Large-scale disasters can often result in catastrophic consequences on people and infrastructure. Situation awareness about such disaster impacts generated by authoritative data fr…
Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Cultures
Tyler A. Chang, Catherine Arnett, Abdelrahman Sadallah +377
To date, there exist almost no culturally-specific evaluation benchmarks for large language models (LLMs) that cover a large number of languages and cultures. In this paper, we pre…
Generalisation Bounds of Zero-Shot Economic Forecasting using Time Series Foundation Models
Jittarin Jetwiriyanon, Teo Susnjak, Surangika Ranathunga
This study investigates zero-shot forecasting capabilities of Time Series Foundation Models (TSFMs) for macroeconomic indicators. We apply TSFMs to forecasting economic indicators…
SinLlama -- A Large Language Model for Sinhala
H. W. K. Aravinda, Rashad Sirajudeen, Samith Karunathilake +3
Low-resource languages such as Sinhala are often overlooked by open-source Large Language Models (LLMs). In this research, we extend an existing multilingual LLM (Llama-3-8B) to be…
Utilizing Multilingual Encoders to Improve Large Language Models for Low-Resource Languages
Imalsha Puranegedara, Themira Chathumina, Nisal Ranathunga +3
Large Language Models (LLMs) excel in English, but their performance degrades significantly on low-resource languages (LRLs) due to English-centric training. While methods like Lan…
Leveraging Synthetic Data for Question Answering with Multilingual LLMs in the Agricultural Domain
Rishemjit Kaur, Arshdeep Singh Bhankhar, Jashanpreet Singh Salh +6
Enabling farmers to access accurate agriculture-related information in their native languages in a timely manner is crucial for the success of the agriculture field. Publicly avail…
Elementary Math Word Problem Generation using Large Language Models
Nimesh Ariyarathne, Harshani Bandara, Yasith Heshan +9
Mathematics is often perceived as a complex subject by students, leading to high failure rates in exams. To improve Mathematics skills, it is important to provide sample questions…
Beyond Vanilla Fine-Tuning: Leveraging Multistage, Multilingual, and Domain-Specific Methods for Low-Resource Machine Translation
Sarubi Thillainathan, Songchen Yuan, En-Shiun Annie Lee +2
Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LR…
A Framework to Assess Multilingual Vulnerabilities of LLMs
Likai Tang, Niruth Bogahawatta, Yasod Ginige +4
Large Language Models (LLMs) are acquiring a wider range of capabilities, including understanding and responding in multiple languages. While they undergo safety training to preven…
Improving the quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics
Aloka Fernando, Nisansa de Silva, Menan Velyuthan +2
Parallel Data Curation (PDC) techniques aim to filter out noisy parallel sentences from web-mined corpora. Ranking sentence pairs using similarity scores on sentence embeddings der…
Linguistic Entity Masking to Improve Cross-Lingual Representation of Multilingual Language Models for Low-Resource Languages
Aloka Fernando, Surangika Ranathunga
Multilingual Pre-trained Language models (multiPLMs), trained on the Masked Language Modelling (MLM) objective are commonly being used for cross-lingual tasks such as bitext mining…