7 papers
LLM-based Atomic Propositions help weak extractors: Evaluation of a Propositioner for triplet extraction
Luc Pommeret, Thomas Gerald, Patrick Paroubek +3
Knowledge Graph construction from natural language requires extracting structured triplets from complex, information-dense sentences. In this paper, we investigate if the decomposi…
A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT
Louis Estève, Christophe Servan, Thomas Lavergne +1
Diversity has been gaining interest in the NLP community in recent years. At the same time, state-of-the-art transformer models such as ModernBERT use very large pre-training datas…
Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learning
Pierre Lepagnol, Sahar Ghannay, Thomas Gerald +2
Understanding user queries is fundamental in many applications, such as home assistants, booking systems, or recommendations. Accordingly, it is crucial to develop accurate Spoken…
Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification
Pierre Lepagnol, Thomas Gerald, Sahar Ghannay +2
This study is part of the debate on the efficiency of large versus small language models for text classification by prompting.We assess the performance of small language models in…
New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark
Nadège Alavoine, Gaëlle Laperriere, Christophe Servan +2
Intent classification and slot-filling are essential tasks of Spoken Language Understanding (SLU). In most SLUsystems, those tasks are realized by independent modules. For about fi…
A Benchmark Evaluation of Clinical Named Entity Recognition in French
Nesrine Bannour, Christophe Servan, Aurélie Névéol +1
Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest…
mALBERT: Is a Compact Multilingual BERT Model Still Worth It?
Christophe Servan, Sahar Ghannay, Sophie Rosset
Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering the…