WorldRoPE: Probabilistic World-Centric Rotary Embedding for Multi-View Attention

Mijeong Kim, Kyujin Lim, Bohyung Han

Rotary Positional Embedding (RoPE) is widely used to encode relative positions in Transformers. In multi-view settings, however, patch coordinates are defined independently in each…