Attention on the Sphere

Boris Bonev, Max Rietmann, Andrea Paris +2

We introduce a generalized attention mechanism for spherical domains, enabling Transformer architectures to natively process data defined on the two-dimensional sphere - a critical…