Depth-Gated LSTM

Kaisheng Yao, Trevor Cohn, Katerina Vylomova +2

In this short note, we present an extension of long short-term memory (LSTM) neural networks to using a depth gate to connect memory cells of adjacent layers. Doing so introduces a…