3.1k citations · 3.4k across the 6 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.CL2018
Continuous Learning in a Hierarchical Multiscale Neural Network
Thomas Wolf, Julien Chaumond, Clement Delangue
We reformulate the problem of encoding a multi-scale representation of a sequence in a language model by casting it in a continuous learning framework. We propose a hierarchical mu…
cs.CL2018
Meta-Learning a Dynamical Language Model
Thomas Wolf, Julien Chaumond, Clement Delangue
We consider the task of word-level language modeling and study the possibility of combining hidden-states-based short-term representations with medium-term representations encoded…