2 papers
cs.LG2026
nD-RoPE: A Generalized RoPE for n-Dimensional Position Embedding
Boyang Li, Yulin Wu, Sizhe Xu +5
Rotary Position Embedding (RoPE) is widely adopted in Transformer models, yet its extension to high-dimensional domains lacks a unified theoretical formulation. Most existing appro…
cs.NE2026
GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spaces
Boyang Li, Yulin Wu, Nuoxian Huang +1
Understanding spatial relationships across all dimensions is fundamental for intelligent systems. However, existing positional embeddings, such as Rotary Positional Embedding (RoPE…