14 citations · 31 across the 28 of their papers we have counts for
8 papers · 1 filter
BanglaShield: A Script-Robust Safety Classifier and Benchmark for Bangla Native, Romanized, and Code-Mixed Prompts
Mohsinul Kabir, Md. Tariquzzaman, Mohammad Rashidujjaman Rifat +2
Safety classifiers for large language models (LLMs) are typically built and evaluated on standard-script text, yet Bangla, like many lower-resource languages, is routinely written…
UK-PRBENCH: A Paragraph-Level Precedent Retrieval Benchmark for United Kingdom Case Law
Damith Premasiri, Tharindu Ranasinghe
Prior case retrieval (PCR) aims to identify precedent cases relevant to a given query case. Existing PCR benchmarks and methods predominantly operate at the document level, treatin…
IndicQE-APE: A Consolidated Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages
Diptesh Kanojia, Archchana Sindhujan, Sourabh Deoghare +14
Indic quality estimation (QE) and automatic post-editing (APE) data is spread across separate releases, so no single resource supports training and evaluation across tasks and lang…
APEX-VW: A Document-Level English-Spanish Post-Editing Dataset in the Healthcare Domain
Marie Escribe, Tharindu Ranasinghe, Amal Haddad Haddad +2
Post-Editing (PE) of Machine Translation (MT) output often involves repeating the same lexical and terminological corrections across many segments, especially in specialised and hi…
ltzGLUE: Luxembourgish General Language Understanding Evaluation
Alistair Plum, Felicia Körner, Anne-Marie Lutgen +8
This paper presents ltzGLUE, the first Natural Language Understanding (NLU) benchmark for Luxembourgish (LTZ) based on the popular GLUE benchmark for English. Although NLU tasks ar…
MUNIChus: Multilingual News Image Captioning Benchmark
Yuji Chen, Alistair Plum, Hansi Hettiarachchi +4
The goal of news image captioning is to generate captions by integrating news article content with corresponding images, highlighting the relationship between textual context and v…
Exploring the Performance of Large Language Models on Subjective Span Identification Tasks
Alphaeus Dmonte, Roland Oruche, Tharindu Ranasinghe +2
Identifying relevant text spans is important for several downstream tasks in NLP, as it contributes to model explainability. While most span identification approaches rely on relat…
Do LLMs Judge Distantly Supervised Named Entity Labels Well? Constructing the JudgeWEL Dataset
Alistair Plum, Laura Bernardy, Tharindu Ranasinghe
We present judgeWEL, a dataset for named entity recognition (NER) in Luxembourgish, automatically labelled and subsequently verified using large language models (LLM) in a novel pi…