Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

Victor Campos, Brendan Jou, Xavier Giro-i-Nieto +2

Recurrent Neural Networks (RNNs) continue to show outstanding performance in sequence modeling tasks. However, training RNNs on long sequences often face challenges like slow infer…