98 citations · 122 across the 7 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.CL2016
A Compositional Approach to Language Modeling
Kushal Arora, Anand Rangarajan
Traditional language models treat language as a finite state automaton on a probability space over words. This is a very strong assumption when modeling something inherently comple…
cs.CL2016★ 6 cited
Contrastive Entropy: A new evaluation metric for unnormalized language models
Kushal Arora, Anand Rangarajan
Perplexity (per word) is the most widely used metric for evaluating language models. Despite this, there has been no dearth of criticism for this metric. Most of these criticisms c…