61 citations · 81 across the 7 of their papers we have counts for
8 papers · 1 filter
STRUCTURALCOST: A controlled reading time dataset for modeling human sentence processing difficulty
Nina Nusbaumer, Iria de-Dios-Flores, Corentin Bel +3
We introduce STRUCTURALCOST, a self-paced reading dataset of 475 participants and 40,800 observations isolating the processing cost of long-distance subject-verb dependency resolut…
RETROcode: Leveraging a Code Database for Improved Natural Language to Code Generation
Nathanaël Beau, Benoît Crabbé
As text and code resources have expanded, large-scale pre-trained models have shown promising capabilities in code generation tasks, typically employing supervised fine-tuning with…
NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data
Sergei Bogdanov, Alexandre Constantin, Timothée Bernard +2
Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use…
Assessing the Capacity of Transformer to Abstract Syntactic Representations: A Contrastive Analysis Based on Long-distance Agreement
Bingzhi Li, Guillaume Wisniewski, Benoît Crabbé
The long-distance agreement, evidence for syntactic structure, is increasingly used to assess the syntactic generalization of Neural Language Models. Much work has shown that trans…
The impact of lexical and grammatical processing on generating code from natural language
Nathanaël Beau, Benoît Crabbé
Considering the seq2seq architecture of TranX for natural language to code translation, we identify four key components of importance: grammatical constraints, lexical preprocessin…
Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement
Bingzhi Li, Guillaume Wisniewski, Benoit Crabbé
Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to…
Can RNNs learn Recursive Nested Subject-Verb Agreements?
Yair Lakretz, Théo Desbordes, Jean-Rémi King +3
One of the fundamental principles of contemporary linguistics states that language processing requires the ability to extract recursively nested tree structures. However, it remain…
FlauBERT: Unsupervised Language Model Pre-training for French
Hang Le, Loïc Vial, Jibril Frej +7
Language models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts…