438 citations · 1.1k across the 12 of their papers we have counts for
1 paper · 1 filter
Mostofa Patwary, Milind Chabbi, Heewoo Jun +3
We show how Zipf's Law can be used to scale up language modeling (LM) to take advantage of more training data and more GPUs. LM plays a key role in many important natural language…