On the Expressive Power of Floating-Point Transformers

Sejun Park, Yeachan Park, Geonho Hwang

The study on the expressive power of transformers shows that transformers are permutation equivariant, and they can approximate all permutation-equivariant continuous functions on…