activity
20212025
most citedMacro-Average: Rare Types Are Important Too

33 citations · 45 across the 17 of their papers we have counts for

collaborators
Showing 2021Show all

7 papers · 1 filter

cs.CL2021

Overview of ADoBo 2021: Automatic Detection of Unassimilated Borrowings in the Spanish Press

Elena Álvarez Mellado, Luis Espinosa Anke, Julio Gonzalo Arroyo +2

This paper summarizes the main findings of the ADoBo 2021 shared task, proposed in the context of IberLef 2021. In this task, we invited participants to detect lexical borrowings (…

cs.CL2021

SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation

Chester Palen-Michel, Nolan Holley, Constantine Lignos

To address a looming crisis of unreproducible evaluation for named entity recognition, we propose guidelines and introduce SeqScore, a software package to improve reproducibility.…

cs.CL2021★ 33 cited

Macro-Average: Rare Types Are Important Too

Thamme Gowda, Weiqiu You, Constantine Lignos +1

While traditional corpus-level evaluation metrics for machine translation (MT) correlate well with fluency, they struggle to reflect adequacy. Model-based MT metrics trained on seg…

cs.CL2021

Mining Wikidata for Name Resources for African Languages

Jonne Sälevä, Constantine Lignos

This work supports further development of language technology for the languages of Africa by providing a Wikidata-derived resource of name lists corresponding to common entity type…

cs.CL2021

TMR: Evaluating NER Recall on Tough Mentions

Jingxuan Tu, Constantine Lignos

We propose the Tough Mentions Recall (TMR) metrics to supplement traditional named entity recognition (NER) evaluation by examining recall on specific subsets of "tough" mentions:…

cs.CL2021★ 2 cited

The Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translation

Jonne Sälevä, Constantine Lignos

This paper evaluates the performance of several modern subword segmentation methods in a low-resource neural machine translation setting. We compare segmentations produced by apply…

cs.CL2021

MasakhaNER: Named Entity Recognition for African Languages

David Ifeoluwa Adelani, Jade Abbott, Graham Neubig +58

We take a step towards addressing the under-representation of the African continent in NLP research by creating the first large publicly available high-quality dataset for named en…