2.2k citations · 5.1k across the 21 of their papers we have counts for
1 paper · 2 filters
Mostofa Patwary, Milind Chabbi, Heewoo Jun +3
We show how Zipf's Law can be used to scale up language modeling (LM) to take advantage of more training data and more GPUs. LM plays a key role in many important natural language…