HySPE: Positional Encoding via Symplectic Dual Shears

Zhongping Ji

We introduce Hyperbolic Symplectic Positional Encoding (HySPE), grounding positional attention in non-compact symplectic transformations. While canonical Rotary Position Embedding…