most citedPaying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.CL2022★ 1 cited

Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding

Shanshan Wang, Zhumin Chen, Zhaochun Ren +3

Pre-trained language models (PLM) have demonstrated their effectiveness for a broad range of information retrieval and natural language processing tasks. As the core part of PLM, m…