Space filling positionality and the Spiroformer

M. Maurin, M. Á. Evangelista-Alvarado, P. Suárez-Serrato

Transformers excel when dealing with sequential data. Generalizing transformer models to geometric domains, such as manifolds, we encounter the problem of not having a well-defined…