13 citations · 13 across the 2 of their papers we have counts for
3 papers · 1 filter
Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement
Bingzhi Li, Guillaume Wisniewski, Benoit Crabbé
Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to…
Can RNNs learn Recursive Nested Subject-Verb Agreements?
Yair Lakretz, Théo Desbordes, Jean-Rémi King +3
One of the fundamental principles of contemporary linguistics states that language processing requires the ability to extract recursively nested tree structures. However, it remain…
FlauBERT: Unsupervised Language Model Pre-training for French
Hang Le, Loïc Vial, Jibril Frej +7
Language models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts…