activity
20182022
most citedTimeLMs: Diachronic Language Models from Twitter

27 citations · 44 across the 5 of their papers we have counts for

collaborators

8 papers

cs.CL2022

Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary

Daniel Loureiro, Alípio Mário Jorge

Progress on commonsense reasoning is usually measured from performance improvements on Question Answering tasks designed to require commonsense knowledge. However, fine-tuning larg…

cs.CL202213 cited

TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media

Daniel Loureiro, Aminette D'Souza, Areej Nasser Muhajab +6

Language evolves over time, and word meaning changes accordingly. This is especially true in social media, since its dynamic nature leads to faster semantic shifts, making it chall…

cs.CL202227 cited

TimeLMs: Diachronic Language Models from Twitter

Daniel Loureiro, Francesco Barbieri, Leonardo Neves +2

Despite its importance, the time variable has been largely neglected in the NLP and language model literature. In this paper, we present TimeLMs, a set of language models specializ…

cs.CL2021

Improving Portuguese Semantic Role Labeling with Transformers and Transfer Learning

Sofia Oliveira, Daniel Loureiro, Alípio Jorge

The Natural Language Processing task of determining "Who did what to whom" is called Semantic Role Labeling. For English, recent methods based on Transformer models have allowed fo…

cs.CL2020

Don't Neglect the Obvious: On the Role of Unambiguous Words in Word Sense Disambiguation

Daniel Loureiro, Jose Camacho-Collados

State-of-the-art methods for Word Sense Disambiguation (WSD) combine two different features: the power of pre-trained language models and a propagation method to extend the coverag…

cs.CL20192 cited

Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense Disambiguation

Daniel Loureiro, Alipio Jorge

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering t…