34 citations · 52 across the 13 of their papers we have counts for
1 paper · 1 filter
Mostofa Patwary, Milind Chabbi, Heewoo Jun +3
We show how Zipf's Law can be used to scale up language modeling (LM) to take advantage of more training data and more GPUs. LM plays a key role in many important natural language…