25.8k citations · 55.9k across the 29 of their papers we have counts for
4 papers · 1 filter
Advances in Pre-Training Distributed Word Representations
Tomas Mikolov, Edouard Grave, Piotr Bojanowski +2
Many Natural Language Processing applications nowadays rely on pre-trained word representations estimated from large text corpora such as news collections, Wikipedia and Web Crawl.…
Fast Linear Model for Knowledge Graph Embeddings
Armand Joulin, Edouard Grave, Piotr Bojanowski +2
This paper shows that a simple baseline based on a Bag-of-Words (BoW) representation learns surprisingly good knowledge graph embeddings. By casting knowledge base completion and q…
Learning Simpler Language Models with the Differential State Framework
Alexander G. Ororbia, Tomas Mikolov, David Reitter
Learning useful information across long time lags is a critical and difficult problem for temporal neural models in tasks such as language modeling. Existing architectures that add…
CommAI: Evaluating the first steps towards a useful general AI
Marco Baroni, Armand Joulin, Allan Jabri +4
With machine learning successfully applied to new daunting problems almost every day, general AI starts looking like an attainable goal. However, most current research focuses inst…