Large Margin Neural Language Model

Jiaji Huang, Yi Li, Wei Ping +1

We propose a large margin criterion for training neural language models. Conventionally, neural language models are trained by minimizing perplexity (PPL) on grammatical sentences.…