Block-Sparse Recurrent Neural Networks

Sharan Narang, Eric Undersander, Gregory Diamos

Recurrent Neural Networks (RNNs) are used in state-of-the-art models in domains such as speech recognition, machine translation, and language modelling. Sparsity is a technique to…