3 papers
cs.LG2026
nD-RoPE: A Generalized RoPE for n-Dimensional Position Embedding
Boyang Li, Yulin Wu, Sizhe Xu +5
Rotary Position Embedding (RoPE) is widely adopted in Transformer models, yet its extension to high-dimensional domains lacks a unified theoretical formulation. Most existing appro…
stat.AP2024
Unveiling Activity-Travel Patterns through Topological Data Analysis
Nuoxian Huang, Yulin Wu
In the context of rapid urbanization, understanding the patterns of urban residents' activities and mobility is crucial for optimizing transportation systems and enhancing urban ma…
cs.NE2024
GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spaces
Boyang Li, Yulin Wu, Nuoxian Huang +1
Understanding spatial relationships across all dimensions is fundamental for intelligent systems. However, existing positional embeddings, such as Rotary Positional Embedding (RoPE…