5 citations · 5 across the 3 of their papers we have counts for
1 paper · 1 filter
Takeru Miyato, Bernhard Jaeger, Max Welling +1
As transformers are equivariant to the permutation of input tokens, encoding the positional information of tokens is necessary for many tasks. However, since existing positional en…