Distance-based Self-Attention Network for Natural Language Inference

Jinbae Im, Sungzoon Cho

Attention mechanism has been used as an ancillary means to help RNN or CNN. However, the Transformer (Vaswani et al., 2017) recently recorded the state-of-the-art performance in ma…