2 citations · 2 across the 1 of their papers we have counts for
1 paper
Ofir Press
Although SGD requires shuffling the training data between epochs, currently none of the word-level language modeling systems do this. Naively shuffling all sentences in the trainin…