Socialformer: Social Network Inspired Long Document Modeling for Document Ranking

Yujia Zhou, Zhicheng Dou, Huaying Yuan +1

Utilizing pre-trained language models has achieved great success for neural document ranking. Limited by the computational and memory requirements, long document modeling becomes a…