84 citations · 178 across the 15 of their papers we have counts for
7 papers · 1 filter
FlauBERT: Unsupervised Language Model Pre-training for French
Hang Le, Loïc Vial, Jibril Frej +7
Language models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts…
Empirical Study of Diachronic Word Embeddings for Scarce Data
Syrielle Montariol, Alexandre Allauzen
Word meaning change can be inferred from drifts of time-varying word embeddings. However, temporal data may be too sparse to build robust word embeddings and to discriminate signif…
Learning dynamic word embeddings with drift regularisation
Syrielle Montariol, Alexandre Allauzen
Word usage, meaning and connotation change throughout time. Diachronic word embeddings are used to grasp these changes in an unsupervised way. In this paper, we use variants of the…
Exploring sentence informativeness
Syrielle Montariol, Aina Garí Soler, Alexandre Allauzen
This study is a preliminary exploration of the concept of informativeness -how much information a sentence gives about a word it contains- and its potential benefits to building qu…
Control of chaotic systems by Deep Reinforcement Learning
Michele Alessandro Bucci, Onofrio Semeraro, Alexandre Allauzen +3
Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learn…
Word Usage Similarity Estimation with Sentence Representations and Automatic Substitutes
Aina Garí Soler, Marianna Apidianaki, Alexandre Allauzen
Usage similarity estimation addresses the semantic proximity of word instances in different contexts. We apply contextualized (ELMo and BERT) word and sentence embeddings to this t…
Towards Recognizing Phrase Translation Processes: Experiments on English-French
Yuming Zhai, Pooyan Safari, Gabriel Illouz +2
When translating phrases (words or group of words), human translators, consciously or not, resort to different translation processes apart from the literal translation, such as Idi…