Multiple Structural Priors Guided Self Attention Network for Language Understanding

Le Qi, Yu Zhang, Qingyu Yin +1

Self attention networks (SANs) have been widely utilized in recent NLP studies. Unlike CNNs or RNNs, standard SANs are usually position-independent, and thus are incapable of captu…