Better Language Model with Hypernym Class Prediction

He Bai, Tong Wang, Alessandro Sordoni +1

Class-based language models (LMs) have been long devised to address context sparsity in $n$-gram LMs. In this study, we revisit this approach in the context of neural LMs. We hypot…