Towards Binary-Valued Gates for Robust LSTM Training

Zhuohan Li, Di He, Fei Tian +4

Long Short-Term Memory (LSTM) is one of the most widely used recurrent structures in sequence modeling. It aims to use gates to control information flow (e.g., whether to skip some…