259 citations · 489 across the 25 of their papers we have counts for
13 papers · 1 filter
Context Copying Modulation: The Role of Entropy Neurons in Managing Parametric and Contextual Knowledge Conflicts
Zineddine Tighidet, Andrea Mogini, Hedi Ben-younes +3
The behavior of Large Language Models (LLMs) when facing contextual information that conflicts with their internal parametric knowledge is inconsistent, with no generally accepted…
Probing Language Models on Their Knowledge Source
Zineddine Tighidet, Andrea Mogini, Jiali Mei +2
Large Language Models (LLMs) often encounter conflicts between their learned, internal (parametric knowledge, PK) and external knowledge provided during inference (contextual knowl…
MEXMA: Token-level objectives improve sentence representations
João Maria Janeiro, Benjamin Piwowarski, Patrick Gallinari +1
Current pre-trained cross-lingual sentence encoders approaches use sentence-level objectives only. This can lead to loss of information, especially for tokens, which then degrades…
Separating Retention from Extraction in the Evaluation of End-to-end Relation Extraction
Bruno Taillé, Vincent Guigue, Geoffrey Scoutheeten +1
State-of-the-art NLP models can adopt shallow heuristics that limit their generalization capability (McCoy et al., 2019). Such heuristics include lexical overlap with the training…
QuestEval: Summarization Asks for Fact-based Evaluation
Thomas Scialom, Paul-Alexis Dray, Patrick Gallinari +4
Summarization evaluation remains an open research problem: current metrics such as ROUGE are known to be limited and to correlate poorly with human judgments. To alleviate this iss…
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation
Clément Rebuffel, Thomas Scialom, Laure Soulier +5
QuestEval is a reference-less metric used in text-to-text tasks, that compares the generated summaries directly to the source text, by automatically asking and answering questions.…