22 citations · 66 across the 5 of their papers we have counts for
1 paper · 1 filter
Hang Zhang, Yeyun Gong, Yelong Shen +4
In this paper, we introduce a two-level attention schema, Poolingformer, for long document modeling. Its first level uses a smaller sliding window pattern to aggregate information…