Refined Gate: A Simple and Effective Gating Mechanism for Recurrent Units

Zhanzhan Cheng, Yunlu Xu, Mingjian Cheng +4

Recurrent neural network (RNN) has been widely studied in sequence learning tasks, while the mainstream models (e.g., LSTM and GRU) rely on the gating mechanism (in control of how…