Contextualized Non-local Neural Networks for Sequence Learning

Pengfei Liu, Shuaichen Chang, Xuanjing Huang +2

Recently, a large number of neural mechanisms and models have been proposed for sequence learning, of which self-attention, as exemplified by the Transformer model, and graph neura…