Pruning and Sparsemax Methods for Hierarchical Attention Networks

João G. Ribeiro, Frederico S. Felisberto, Isabel C. Neto

This paper introduces and evaluates two novel Hierarchical Attention Network models [Yang et al., 2016] - i) Hierarchical Pruned Attention Networks, which remove the irrelevant wor…