2 citations · 4 across the 8 of their papers we have counts for
1 paper · 2 filters
Jian Xu, Chao Li, Delu Zeng +2
Standard dot-product self-attention computes, in a single layer, only pairwise (order-2) interactions between tokens; representing a generic order-k interaction is known to requi…