126 citations · 388 across the 24 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.CL2018★ 2 cited
Language Modeling at Scale
Mostofa Patwary, Milind Chabbi, Heewoo Jun +3
We show how Zipf's Law can be used to scale up language modeling (LM) to take advantage of more training data and more GPUs. LM plays a key role in many important natural language…
cs.CL2018
Large Margin Neural Language Model
Jiaji Huang, Yi Li, Wei Ping +1
We propose a large margin criterion for training neural language models. Conventionally, neural language models are trained by minimizing perplexity (PPL) on grammatical sentences.…