177 citations · 192 across the 5 of their papers we have counts for
6 papers
Patent Representation Learning via Self-supervision
You Zuo, Kim Gerdes, Éric de la Clergerie +1
We study self-supervised patent representation learning with contrastive objectives. A standard baseline constructs positives by encoding the same text twice under independent drop…
Rethinking Automatic Evaluation in Sentence Simplification
Thomas Scialom, Louis Martin, Jacopo Staiano +2
Automatic evaluation remains an open research question in Natural Language Generation. In the context of Sentence Simplification, this is particularly challenging: the task require…
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Julia Kreutzer, Isaac Caswell, Lisa Wang +49
With the success of large-scale pre-training and multilingual modeling in Natural Language Processing (NLP), recent years have seen a proliferation of large, web-mined text dataset…
First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT
Benjamin Muller, Yanai Elazar, Benoît Sagot +1
Multilingual pretrained language models have demonstrated remarkable zero-shot cross-lingual transfer capabilities. Such transfer emerges by fine-tuning on a task of interest in on…
Neural language modeling of free word order argument structure
Charlotte Rochereau, Benoît Sagot, Emmanuel Dupoux
Neural language models trained with a predictive or masked objective have proven successful at capturing short and long distance syntactic dependencies. Here, we focus on verb argu…
External Lexical Information for Multilingual Part-of-Speech Tagging
Benoît Sagot
Morphosyntactic lexicons and word vector representations have both proven useful for improving the accuracy of statistical part-of-speech taggers. Here we compare the performances…