4 papers · 1 filter
Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification
Pierre Lepagnol, Thomas Gerald, Sahar Ghannay +2
This study is part of the debate on the efficiency of large versus small language models for text classification by prompting.We assess the performance of small language models in…
New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark
Nadège Alavoine, Gaëlle Laperriere, Christophe Servan +2
Intent classification and slot-filling are essential tasks of Spoken Language Understanding (SLU). In most SLUsystems, those tasks are realized by independent modules. For about fi…
A Benchmark Evaluation of Clinical Named Entity Recognition in French
Nesrine Bannour, Christophe Servan, Aurélie Névéol +1
Background: Transformer-based language models have shown strong performance on many Natural LanguageProcessing (NLP) tasks. Masked Language Models (MLMs) attract sustained interest…
mALBERT: Is a Compact Multilingual BERT Model Still Worth It?
Christophe Servan, Sahar Ghannay, Sophie Rosset
Within the current trend of Pretained Language Models (PLM), emerge more and more criticisms about the ethical andecological impact of such models. In this article, considering the…