Unigram-Normalized Perplexity as a Language Model Performance Measure with Different Vocabulary Sizes

Jihyeon Roh, Sang-Hoon Oh, Soo-Young Lee

Although Perplexity is a widely used performance metric for language models, the values are highly dependent upon the number of words in the corpus and is useful to compare perform…