Spline-based Transformers

Prashanth Chandran, Agon Serifi, Markus Gross +1

We introduce Spline-based Transformers, a novel class of Transformer models that eliminate the need for positional encoding. Inspired by workflows using splines in computer animati…