Diverse Embedding Neural Network Language Models

Kartik Audhkhasi, Abhinav Sethy, Bhuvana Ramabhadran

We propose Diverse Embedding Neural Network (DENN), a novel architecture for language models (LMs). A DENNLM projects the input word history vector onto multiple diverse low-dimens…