Language Modeling with Highway LSTM

Gakuto Kurata, Bhuvana Ramabhadran, George Saon +1

Language models (LMs) based on Long Short Term Memory (LSTM) have shown good gains in many automatic speech recognition tasks. In this paper, we extend an LSTM by adding highway ne…