5.1k citations · 5.5k across the 7 of their papers we have counts for
7 papers
Collapse of Self-trained Language Models
David Herel, Tomas Mikolov
In various fields of knowledge creation, including science, new ideas often build on pre-existing information. In this work, we explore this concept within the context of language…
Emergence of Novelty in Evolutionary Algorithms
David Herel, Dominika Zogatova, Matej Kripner +1
One of the main problems of evolutionary algorithms is the convergence of the population to local minima. In this paper, we explore techniques that can avoid this problem by encour…
CommAI: Evaluating the first steps towards a useful general AI
Marco Baroni, Armand Joulin, Allan Jabri +4
With machine learning successfully applied to new daunting problems almost every day, general AI starts looking like an attainable goal. However, most current research focuses inst…
Variable Computation in Recurrent Neural Networks
Yacine Jernite, Edouard Grave, Armand Joulin +1
Recurrent neural networks (RNNs) have been used extensively and with increasing success to model various types of sequential data. Much of this progress has been achieved through d…
Learning Longer Memory in Recurrent Neural Networks
Tomas Mikolov, Armand Joulin, Sumit Chopra +2
Recurrent neural network is a powerful model that learns temporal patterns in sequential data. For a long time, it was believed that recurrent networks are difficult to train using…
Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews
Grégoire Mesnil, Tomas Mikolov, Marc'Aurelio Ranzato +1
Sentiment analysis is a common task in natural language processing that aims to detect polarity of a text document (typically a consumer review). In the simplest settings, we discr…